2024-04-06T03:16:01.215 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-06T03:16:01.216 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934 --verbose --owner scheduled_teuthology@teuthology --description orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} --name teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934/orig.config.yaml 2024-04-06T03:16:01.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T03:16:01.335 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934 branch: squid description: orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} email: ceph-qa@ceph.com first_in_suite: false job_id: '7641934' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: 9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 extra_packages: - cephadm selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: squid sha1: 584a67ccb9eb224c5312dccd96a82e67b0645518 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 5609 sha1: 9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 sleep_before_teardown: 0 subset: 32/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_584a67ccb9eb224c5312dccd96a82e67b0645518/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 584a67ccb9eb224c5312dccd96a82e67b0645518 targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI1cEsLkHa93Q+cIob9h3X2IcOdJd3tHOJ2sqLEN5BmJtlVrLacnB2ce9eNcLxj/TnQ7KMOCIEDMizOfOSEoo6M= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJRiuYufg69nO624sWYbxrly7zLSidXuHlOjBhm0Pt9H6rlgMK+aq7YahZOT7MICJaG0e/fOuSbagWBw7Lv5h8c= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-05_21:08:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-06T03:16:01.335 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_584a67ccb9eb224c5312dccd96a82e67b0645518/qa; will attempt to use it 2024-04-06T03:16:01.336 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_584a67ccb9eb224c5312dccd96a82e67b0645518/qa/tasks 2024-04-06T03:16:01.336 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-06T03:16:01.337 INFO:teuthology.task.internal:Checking packages... 2024-04-06T03:16:01.362 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9f192350ba5fe6d0a365b251a8c2af61f56a5fa6' 2024-04-06T03:16:01.362 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-06T03:16:01.363 INFO:teuthology.packaging:ref: None 2024-04-06T03:16:01.363 INFO:teuthology.packaging:tag: None 2024-04-06T03:16:01.363 INFO:teuthology.packaging:branch: squid 2024-04-06T03:16:01.363 INFO:teuthology.packaging:sha1: 9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 2024-04-06T03:16:01.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-06T03:16:01.571 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2041.g584a67cc 2024-04-06T03:16:01.572 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-06T03:16:01.579 INFO:teuthology.task.internal:no buildpackages task found 2024-04-06T03:16:01.579 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-06T03:16:01.604 INFO:teuthology.task.internal:Saving configuration 2024-04-06T03:16:01.615 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-06T03:16:01.629 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-06T03:16:01.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-06 03:11:08.128629', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI1cEsLkHa93Q+cIob9h3X2IcOdJd3tHOJ2sqLEN5BmJtlVrLacnB2ce9eNcLxj/TnQ7KMOCIEDMizOfOSEoo6M='} 2024-04-06T03:16:01.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-06 03:11:08.127264', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJRiuYufg69nO624sWYbxrly7zLSidXuHlOjBhm0Pt9H6rlgMK+aq7YahZOT7MICJaG0e/fOuSbagWBw7Lv5h8c='} 2024-04-06T03:16:01.679 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-06T03:16:01.685 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-04-06T03:16:01.685 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-04-06T03:16:01.685 INFO:teuthology.run_tasks:Running task console_log... 2024-04-06T03:16:01.825 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1f19dcaf70>, signals=[15]) 2024-04-06T03:16:01.825 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-06T03:16:01.831 INFO:teuthology.task.internal:Opening connections... 2024-04-06T03:16:01.831 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-04-06T03:16:01.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T03:16:01.935 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-04-06T03:16:01.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T03:16:02.020 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-06T03:16:02.027 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-04-06T03:16:02.045 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-04-06T03:16:02.045 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-04-06T03:16:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-04-06T03:16:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-04-06T03:16:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-04-06T03:16:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-04-06T03:16:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-04-06T03:16:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-04-06T03:16:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-06T03:16:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-04-06T03:16:02.104 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-04-06T03:16:02.104 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-06T03:16:02.104 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-04-06T03:16:02.104 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T03:16:02.104 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-06T03:16:02.104 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T03:16:02.104 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-04-06T03:16:02.129 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-04-06T03:16:02.146 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-04-06T03:16:02.147 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-04-06T03:16:02.202 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-06T03:16:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T03:16:02.204 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-04-06T03:16:02.221 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-06T03:16:02.229 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-06T03:16:02.254 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-06T03:16:02.255 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-04-06T03:16:02.257 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-04-06T03:16:02.272 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-06T03:16:02.278 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-06T03:16:02.278 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-04-06T03:16:02.315 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-04-06T03:16:02.431 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-06T03:16:02.485 INFO:teuthology.run_tasks:Running task kernel... 2024-04-06T03:16:02.499 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-06T03:16:02.500 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-06T03:16:02.500 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-06T03:16:02.500 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-06T03:16:02.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T03:16:02.517 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-04-06T03:16:02.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T03:16:02.518 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-06T03:16:02.574 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-361.el9.x86_64 2024-04-06T03:16:02.574 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-361.el9.x86_64 2024-04-06T03:16:02.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-04-06T03:16:02.576 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-361.el9.x86_64 2024-04-06T03:16:02.576 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-361.el9.x86_64 2024-04-06T03:16:02.576 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-04-06T03:16:04.760 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-04-06T03:16:04.856 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-04-06T03:16:06.377 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 8.1 MB/s | 2.5 MB 00:00 2024-04-06T03:16:06.515 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - BaseOS 8.9 MB/s | 2.5 MB 00:00 2024-04-06T03:16:07.356 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.0 MB 00:00 2024-04-06T03:16:10.592 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.0 MB 00:03 2024-04-06T03:16:11.898 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 19 MB 00:03 2024-04-06T03:16:13.485 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-04-06T03:16:17.019 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.1 MB 00:01 2024-04-06T03:16:18.475 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 16 kB 00:00 2024-04-06T03:16:20.369 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.1 MB 00:03 2024-04-06T03:16:21.803 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-04-06T03:16:23.582 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-06T03:16:28.647 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-06T03:16:30.801 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:16:30.801 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:16:30.801 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:16:30.801 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.801 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:16:30.801 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.802 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.803 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.804 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.805 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:16:30.806 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:16:30.807 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.808 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.808 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.808 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.808 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.808 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.808 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:16:30.808 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.808 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.809 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:16:30.810 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.811 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.811 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:16:30.811 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:16:31.295 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-06T03:16:31.296 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-06T03:16:31.414 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:16:31.418 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:16:31.418 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-04-06T03:16:31.418 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:16:31.418 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:16:31.418 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-04-06T03:16:31.418 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:16:31.418 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-04-06T03:16:31.419 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-04-06T03:16:31.419 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-04-06T03:16:31.419 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:16:31.419 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:16:31.419 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:16:31.419 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-04-06T03:16:31.419 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:16:31.420 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 76 M 2024-04-06T03:16:31.420 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 123 M 2024-04-06T03:16:31.420 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:16:31.773 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 312 kB/s | 66 kB 00:00 2024-04-06T03:16:32.190 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-core-5.14.0-432.el9.x86_64.rpm 24 MB/s | 15 MB 00:00 2024-04-06T03:16:32.815 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 27 MB/s | 33 MB 00:01 2024-04-06T03:16:33.257 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-core-5.14.0-432.el9.x86_6 19 MB/s | 27 MB 00:01 2024-04-06T03:16:33.260 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:16:33.260 INFO:teuthology.orchestra.run.smithi102.stdout:Total 41 MB/s | 76 MB 00:01 2024-04-06T03:16:33.926 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:16:34.274 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:16:34.274 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:16:35.298 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:16:35.298 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:16:37.781 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:16:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-04-06T03:16:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-04-06T03:16:40.061 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 992 kB/s | 21 MB 00:21 2024-04-06T03:16:41.228 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-04-06T03:16:41.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-04-06T03:16:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-06T03:16:46.095 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-04-06T03:16:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:16:47.536 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:16:47.536 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:16:47.536 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:16:47.537 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.538 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.539 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:16:47.931 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-06T03:16:47.932 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-06T03:16:48.040 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:16:48.048 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:16:48.048 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-04-06T03:16:48.048 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:16:48.048 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:16:48.048 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:16:48.049 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 76 M 2024-04-06T03:16:48.050 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 123 M 2024-04-06T03:16:48.050 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:16:48.826 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 92 kB/s | 66 kB 00:00 2024-04-06T03:16:50.963 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:17:09.974 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-core-5.14.0-432.el9.x86_64.rpm 699 kB/s | 15 MB 00:21 2024-04-06T03:17:20.195 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:17:20.195 INFO:teuthology.orchestra.run.smithi102.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-06T03:17:20.195 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:17:20.239 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:17:20.603 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:17:20.603 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-04-06T03:17:20.604 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-04-06T03:17:20.604 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-04-06T03:17:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:17:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:17:21.030 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:17:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-432.el9.x86_64 2024-04-06T03:17:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-04-06T03:17:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-04-06T03:17:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-04-06T03:17:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:17:21.031 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:17:21.368 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-04-06T03:17:21.501 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-432.el9.x86_64 2024-04-06T03:17:21.502 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-04-06T03:17:21.502 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-04-06T03:17:21.502 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-06T03:17:21.502 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-06T03:17:21.502 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-06T03:17:21.502 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-04-06T03:17:21.502 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-04-06T03:17:21.582 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-432.el9.x86_64 2024-04-06T03:17:21.582 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-04-06T03:17:21.582 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-04-06T03:17:21.615 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-04-06T03:17:21.615 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-04-06T03:17:21.615 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 68.el9 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8264254 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-06T03:17:21.616 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-04-06T03:17:21.617 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-04-06T03:17:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:17:21.617 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-06T03:17:21.617 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-06T03:17:21.617 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-06T03:17:21.617 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-04-06T03:17:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:17:21.617 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-04-06T03:17:21.618 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-06T03:17:21.618 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-432.el9.x86_64 2024-04-06T03:17:21.618 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-06T03:17:22.250 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-04-06T03:17:23.647 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-06T03:17:23.674 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-04-06T03:17:23.676 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-04-06T03:17:23.691 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.t5a9oNKthB 2024-04-06T03:17:23.692 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.t5a9oNKthB 2024-04-06T03:17:23.761 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.t5a9oNKthB 2024-04-06T03:17:23.896 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.t5a9oNKthB is 6KB 2024-04-06T03:17:23.945 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.t5a9oNKthB 2024-04-06T03:17:23.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-04-06T03:17:24.023 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-06T03:17:24.023 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-06T03:17:24.023 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-06T03:17:24.023 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-04-06T03:17:24.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-04-06T03:17:24.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-04-06T03:17:27.006 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-core-5.14.0-432.el9.x86_6 737 kB/s | 27 MB 00:38 2024-04-06T03:17:39.205 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 671 kB/s | 33 MB 00:51 2024-04-06T03:17:39.206 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:17:39.206 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.5 MB/s | 76 MB 00:51 2024-04-06T03:17:39.894 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:17:40.322 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:17:40.322 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:17:41.364 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:17:41.364 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:17:43.972 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:17:44.608 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-04-06T03:17:44.691 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-04-06T03:17:47.582 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-04-06T03:17:47.717 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-04-06T03:17:52.813 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-04-06T03:17:52.850 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:17:54.177 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-06T03:17:54.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-06T03:17:54.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T03:17:57.977 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:18:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:18:28.820 INFO:teuthology.orchestra.run.smithi047.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-06T03:18:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:18:28.865 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-04-06T03:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-04-06T03:18:29.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-04-06T03:18:29.654 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-04-06T03:18:29.654 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:18:29.654 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:18:29.654 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-432.el9.x86_64 2024-04-06T03:18:29.655 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-04-06T03:18:29.655 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-04-06T03:18:29.655 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-04-06T03:18:29.655 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:18:29.655 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:18:29.963 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-04-06T03:18:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-432.el9.x86_64 2024-04-06T03:18:30.090 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-04-06T03:18:30.090 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-04-06T03:18:30.090 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-06T03:18:30.090 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-06T03:18:30.091 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-06T03:18:30.091 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-04-06T03:18:30.091 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-04-06T03:18:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-432.el9.x86_64 2024-04-06T03:18:30.174 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-04-06T03:18:30.174 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-04-06T03:18:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-04-06T03:18:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-04-06T03:18:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-04-06T03:18:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 68.el9 2024-04-06T03:18:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-04-06T03:18:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8264254 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-06T03:18:30.220 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-04-06T03:18:30.221 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-04-06T03:18:30.221 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:18:30.221 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-06T03:18:30.221 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-06T03:18:30.221 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-06T03:18:30.221 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-04-06T03:18:30.221 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:18:30.221 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-04-06T03:18:30.222 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-06T03:18:30.222 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-432.el9.x86_64 2024-04-06T03:18:30.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-06T03:18:30.882 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-04-06T03:18:32.282 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-06T03:18:32.312 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-04-06T03:18:32.314 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-04-06T03:18:32.329 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.JuBHapx2Lv 2024-04-06T03:18:32.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JuBHapx2Lv 2024-04-06T03:18:32.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.JuBHapx2Lv 2024-04-06T03:18:32.545 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.JuBHapx2Lv is 6KB 2024-04-06T03:18:32.593 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.JuBHapx2Lv 2024-04-06T03:18:32.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-04-06T03:18:32.676 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-06T03:18:32.677 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-06T03:18:32.677 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-06T03:18:32.677 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-04-06T03:18:32.678 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-04-06T03:18:32.841 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-04-06T03:18:54.203 DEBUG:teuthology.orchestra.remote:timed out 2024-04-06T03:19:02.849 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-06T03:19:02.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-06T03:19:02.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T03:19:03.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-06T03:19:03.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T03:19:06.748 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-04-06T03:19:07.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-06T03:19:07.169 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-432.el9.x86_64"... 2024-04-06T03:19:07.169 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-04-06T03:19:07.183 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-432.el9.x86_64 2024-04-06T03:19:07.183 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-04-06T03:19:07.184 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-06T03:19:07.184 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-06T03:19:08.184 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-06T03:19:08.184 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-06T03:19:08.262 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-04-06T03:19:08.299 DEBUG:teuthology.parallel:result is None 2024-04-06T03:20:02.854 DEBUG:teuthology.orchestra.remote:timed out 2024-04-06T03:20:11.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-06T03:20:11.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T03:20:12.207 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-06T03:20:12.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-06T03:20:12.729 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-432.el9.x86_64"... 2024-04-06T03:20:12.729 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-06T03:20:12.759 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-432.el9.x86_64 2024-04-06T03:20:12.759 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-04-06T03:20:12.759 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-06T03:20:12.759 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-06T03:20:13.760 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-06T03:20:13.760 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-06T03:20:13.827 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-04-06T03:20:13.919 DEBUG:teuthology.parallel:result is None 2024-04-06T03:20:13.919 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-06T03:20:13.927 INFO:teuthology.task.internal:Creating test directory... 2024-04-06T03:20:13.927 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-06T03:20:13.930 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-06T03:20:13.948 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-06T03:20:13.976 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-06T03:20:14.031 INFO:teuthology.task.internal:Creating archive directory... 2024-04-06T03:20:14.031 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-06T03:20:14.034 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-06T03:20:14.068 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-06T03:20:14.076 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-06T03:20:14.077 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-06T03:20:14.098 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-06T03:20:14.126 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-06T03:20:14.139 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-06T03:20:14.140 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-06T03:20:14.155 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-06T03:20:14.156 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-06T03:20:14.164 INFO:teuthology.task.internal:Configuring sudo... 2024-04-06T03:20:14.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-06T03:20:14.181 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-06T03:20:14.227 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-06T03:20:14.236 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-06T03:20:14.236 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-06T03:20:14.245 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-06T03:20:14.283 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-06T03:20:14.339 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-06T03:20:14.389 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-06T03:20:14.468 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-06T03:20:14.509 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:20:14.509 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-06T03:20:14.573 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-06T03:20:14.618 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-06T03:20:14.672 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-06T03:20:14.761 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-06T03:20:14.802 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:20:14.802 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-06T03:20:14.871 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-04-06T03:20:14.873 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-04-06T03:20:14.918 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-06T03:20:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-06T03:20:15.365 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-06T03:20:15.373 INFO:teuthology.task.internal:Starting timer... 2024-04-06T03:20:15.373 INFO:teuthology.run_tasks:Running task pcp... 2024-04-06T03:20:15.435 INFO:teuthology.run_tasks:Running task selinux... 2024-04-06T03:20:15.483 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-06T03:20:15.483 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-04-06T03:20:15.542 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-04-06T03:20:15.544 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-04-06T03:20:15.621 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-04-06T03:20:15.623 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-06T03:20:15.623 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-04-06T03:20:15.648 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-04-06T03:20:15.648 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-04-06T03:20:15.683 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-04-06T03:20:15.683 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2024-04-06T03:20:15.683 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-06T03:20:15.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T03:20:15.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-06T03:20:15.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T03:20:15.752 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-06T03:20:15.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-04-06T03:20:15.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-04-06T03:20:15.827 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-06T03:20:15.837 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-06T03:20:15.854 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-06T03:20:15.855 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-06T03:24:34.972 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-04-06T03:24:34.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-06T03:24:34.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T03:24:35.074 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-06T03:24:35.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-06T03:24:35.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-06T03:24:35.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T03:24:35.235 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-04-06T03:24:35.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-06T03:24:35.322 INFO:teuthology.run_tasks:Running task clock... 2024-04-06T03:24:35.333 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-06T03:24:35.333 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-06T03:24:35.334 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-06T03:24:35.336 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-06T03:24:35.336 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-06T03:24:35.366 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-06T03:24:35.383 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-06T03:24:35.393 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-06T03:24:35.410 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-06T03:24:35.413 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-04-06T03:24:35.427 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-04-06T03:24:35.439 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-04-06T03:24:35.443 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-06T03:24:35.453 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-04-06T03:24:35.459 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-06T03:24:35.470 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-06T03:24:35.486 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-06T03:24:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-04-06T03:24:35.515 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-06T03:24:35.515 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-04-06T03:24:35.515 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T03:24:35.515 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T03:24:35.515 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T03:24:35.515 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T03:24:35.538 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-04-06T03:24:35.542 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-06T03:24:35.542 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-04-06T03:24:35.542 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T03:24:35.542 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T03:24:35.542 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T03:24:35.542 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T03:24:35.543 INFO:teuthology.run_tasks:Running task install... 2024-04-06T03:24:35.552 DEBUG:teuthology.task.install:project ceph 2024-04-06T03:24:35.552 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9f192350ba5fe6d0a365b251a8c2af61f56a5fa6'}, 'extra_packages': ['cephadm']} 2024-04-06T03:24:35.552 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '9f192350ba5fe6d0a365b251a8c2af61f56a5fa6'} 2024-04-06T03:24:35.552 INFO:teuthology.task.install:Using flavor: default 2024-04-06T03:24:35.561 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-06T03:24:35.562 INFO:teuthology.task.install:extra packages: [] 2024-04-06T03:24:35.562 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9f192350ba5fe6d0a365b251a8c2af61f56a5fa6', 'tag': None, 'wait_for_package': False} 2024-04-06T03:24:35.563 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 2024-04-06T03:24:35.567 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9f192350ba5fe6d0a365b251a8c2af61f56a5fa6', 'tag': None, 'wait_for_package': False} 2024-04-06T03:24:35.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 2024-04-06T03:24:35.713 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/centos/9/flavors/default/ 2024-04-06T03:24:35.713 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2027.g9f192350 2024-04-06T03:24:35.786 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/centos/9/flavors/default/ 2024-04-06T03:24:35.787 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2027.g9f192350 2024-04-06T03:24:35.824 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-06T03:24:35.824 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:24:35.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-06T03:24:35.855 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-06T03:24:35.855 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-06T03:24:35.898 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-06T03:24:35.898 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:24:35.898 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-06T03:24:35.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-06T03:24:35.930 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-06T03:24:35.930 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9f192350ba5fe6d0a365b251a8c2af61f56a5fa6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-06T03:24:35.998 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-06T03:24:36.006 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-06T03:24:36.072 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-04-06T03:24:36.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-04-06T03:24:36.078 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-06T03:24:36.144 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-04-06T03:24:36.146 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-04-06T03:24:36.320 INFO:teuthology.orchestra.run.smithi102.stdout:74 files removed 2024-04-06T03:24:36.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw 2024-04-06T03:24:36.390 INFO:teuthology.orchestra.run.smithi047.stdout:74 files removed 2024-04-06T03:24:36.417 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw 2024-04-06T03:24:37.021 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 222 kB/s | 83 kB 00:00 2024-04-06T03:24:37.202 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 173 kB/s | 83 kB 00:00 2024-04-06T03:24:37.413 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-04-06T03:24:37.602 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-04-06T03:24:37.855 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-06T03:24:37.978 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-04-06T03:24:38.308 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 20 MB/s | 8.1 MB 00:00 2024-04-06T03:24:38.447 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - AppStream 19 MB/s | 8.1 MB 00:00 2024-04-06T03:24:40.066 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.5 MB 00:00 2024-04-06T03:24:40.130 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - BaseOS 8.8 MB/s | 2.5 MB 00:00 2024-04-06T03:24:40.899 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 22 MB/s | 8.0 MB 00:00 2024-04-06T03:24:41.062 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.0 MB 00:00 2024-04-06T03:24:42.600 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-04-06T03:24:43.197 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-06T03:24:46.812 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.1 MB 00:00 2024-04-06T03:24:47.473 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-04-06T03:24:48.410 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 16 kB 00:00 2024-04-06T03:24:48.924 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 16 kB 00:00 2024-04-06T03:24:49.931 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-06T03:24:50.295 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-06T03:24:54.987 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-06T03:24:55.442 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-06T03:24:57.420 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:24:57.420 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:24:57.420 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:24:57.420 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.420 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:24:57.420 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.420 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.421 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.422 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.423 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.424 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:24:57.425 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:24:57.426 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.428 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.430 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.430 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.954 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:24:57.957 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.0.0-2027.g9f192350.el9 ceph 9.8 M 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 3.4 M 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 3.1 M 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.0.0-2027.g9f192350.el9 ceph 5.3 M 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.0.0-2027.g9f192350.el9 ceph 21 M 2024-04-06T03:24:57.958 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.0.0-2027.g9f192350.el9 ceph 25 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 745 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 501 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 5.1 M 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-06T03:24:57.959 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.0.0-2027.g9f192350.el9 ceph 45 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.0.0-2027.g9f192350.el9 ceph 131 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.0.0-2027.g9f192350.el9 ceph 162 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.0.0-2027.g9f192350.el9 ceph 320 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.0.0-2027.g9f192350.el9 ceph 298 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.0.0-2027.g9f192350.el9 ceph 99 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-06T03:24:57.960 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout:Install 30 Packages 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 2 Packages 2024-04-06T03:24:57.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:24:57.962 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 59 M 2024-04-06T03:24:57.962 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:24:57.962 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:24:57.962 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:24:57.962 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:24:57.963 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.964 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:24:57.964 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.964 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:24:57.964 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.964 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:24:57.964 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.964 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:24:57.964 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:24:57.965 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:24:57.966 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:24:57.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:24:57.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:24:58.469 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.0.0-2027.g9f192350.el9 ceph 9.8 M 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 3.4 M 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 3.1 M 2024-04-06T03:24:58.482 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.0.0-2027.g9f192350.el9 ceph 5.3 M 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.0.0-2027.g9f192350.el9 ceph 21 M 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.0.0-2027.g9f192350.el9 ceph 25 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 745 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 501 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-06T03:24:58.483 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.0.0-2027.g9f192350.el9 ceph 5.1 M 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.0.0-2027.g9f192350.el9 ceph 45 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.0.0-2027.g9f192350.el9 ceph 131 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.0.0-2027.g9f192350.el9 ceph 162 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.0.0-2027.g9f192350.el9 ceph 320 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.0.0-2027.g9f192350.el9 ceph 298 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.0.0-2027.g9f192350.el9 ceph 99 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-06T03:24:58.484 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout:Install 30 Packages 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 2 Packages 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:24:58.485 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 59 M 2024-04-06T03:24:58.486 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:24:59.355 INFO:teuthology.orchestra.run.smithi102.stdout:(1/32): ceph-radosgw-19.0.0-2027.g9f192350.el9. 9.0 MB/s | 9.8 MB 00:01 2024-04-06T03:24:59.397 INFO:teuthology.orchestra.run.smithi102.stdout:(2/32): ceph-selinux-19.0.0-2027.g9f192350.el9. 607 kB/s | 25 kB 00:00 2024-04-06T03:24:59.489 INFO:teuthology.orchestra.run.smithi102.stdout:(3/32): libcephfs2-19.0.0-2027.g9f192350.el9.x8 8.0 MB/s | 745 kB 00:00 2024-04-06T03:24:59.547 INFO:teuthology.orchestra.run.smithi102.stdout:(4/32): libradosstriper1-19.0.0-2027.g9f192350. 8.4 MB/s | 501 kB 00:00 2024-04-06T03:24:59.989 INFO:teuthology.orchestra.run.smithi102.stdout:(5/32): librgw2-19.0.0-2027.g9f192350.el9.x86_6 12 MB/s | 5.1 MB 00:00 2024-04-06T03:25:00.039 INFO:teuthology.orchestra.run.smithi102.stdout:(6/32): python3-ceph-argparse-19.0.0-2027.g9f19 904 kB/s | 45 kB 00:00 2024-04-06T03:25:00.090 INFO:teuthology.orchestra.run.smithi102.stdout:(7/32): python3-ceph-common-19.0.0-2027.g9f1923 2.6 MB/s | 131 kB 00:00 2024-04-06T03:25:00.093 INFO:teuthology.orchestra.run.smithi047.stdout:(1/32): ceph-base-19.0.0-2027.g9f192350.el9.x86 5.1 MB/s | 5.3 MB 00:01 2024-04-06T03:25:00.141 INFO:teuthology.orchestra.run.smithi102.stdout:(8/32): python3-cephfs-19.0.0-2027.g9f192350.el 3.2 MB/s | 162 kB 00:00 2024-04-06T03:25:00.143 INFO:teuthology.orchestra.run.smithi047.stdout:(2/32): ceph-selinux-19.0.0-2027.g9f192350.el9. 504 kB/s | 25 kB 00:00 2024-04-06T03:25:00.191 INFO:teuthology.orchestra.run.smithi102.stdout:(9/32): python3-rados-19.0.0-2027.g9f192350.el9 6.3 MB/s | 320 kB 00:00 2024-04-06T03:25:00.252 INFO:teuthology.orchestra.run.smithi047.stdout:(3/32): libcephfs2-19.0.0-2027.g9f192350.el9.x8 6.7 MB/s | 745 kB 00:00 2024-04-06T03:25:00.257 INFO:teuthology.orchestra.run.smithi102.stdout:(10/32): python3-rbd-19.0.0-2027.g9f192350.el9. 4.4 MB/s | 298 kB 00:00 2024-04-06T03:25:00.324 INFO:teuthology.orchestra.run.smithi102.stdout:(11/32): python3-rgw-19.0.0-2027.g9f192350.el9. 1.5 MB/s | 99 kB 00:00 2024-04-06T03:25:00.361 INFO:teuthology.orchestra.run.smithi047.stdout:(4/32): libradosstriper1-19.0.0-2027.g9f192350. 4.5 MB/s | 501 kB 00:00 2024-04-06T03:25:00.875 INFO:teuthology.orchestra.run.smithi102.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 194 kB/s | 107 kB 00:00 2024-04-06T03:25:00.994 INFO:teuthology.orchestra.run.smithi047.stdout:(5/32): librgw2-19.0.0-2027.g9f192350.el9.x86_6 8.1 MB/s | 5.1 MB 00:00 2024-04-06T03:25:01.066 INFO:teuthology.orchestra.run.smithi102.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 837 kB/s | 160 kB 00:00 2024-04-06T03:25:01.203 INFO:teuthology.orchestra.run.smithi047.stdout:(6/32): ceph-common-19.0.0-2027.g9f192350.el9.x 9.5 MB/s | 21 MB 00:02 2024-04-06T03:25:01.217 INFO:teuthology.orchestra.run.smithi102.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 301 kB/s | 45 kB 00:00 2024-04-06T03:25:01.228 INFO:teuthology.orchestra.run.smithi047.stdout:(7/32): python3-ceph-argparse-19.0.0-2027.g9f19 193 kB/s | 45 kB 00:00 2024-04-06T03:25:01.279 INFO:teuthology.orchestra.run.smithi047.stdout:(8/32): python3-ceph-common-19.0.0-2027.g9f1923 1.7 MB/s | 131 kB 00:00 2024-04-06T03:25:01.303 INFO:teuthology.orchestra.run.smithi047.stdout:(9/32): python3-cephfs-19.0.0-2027.g9f192350.el 2.1 MB/s | 162 kB 00:00 2024-04-06T03:25:01.329 INFO:teuthology.orchestra.run.smithi047.stdout:(10/32): python3-rados-19.0.0-2027.g9f192350.el 6.3 MB/s | 320 kB 00:00 2024-04-06T03:25:01.354 INFO:teuthology.orchestra.run.smithi047.stdout:(11/32): python3-rbd-19.0.0-2027.g9f192350.el9. 5.8 MB/s | 298 kB 00:00 2024-04-06T03:25:01.380 INFO:teuthology.orchestra.run.smithi047.stdout:(12/32): python3-rgw-19.0.0-2027.g9f192350.el9. 1.9 MB/s | 99 kB 00:00 2024-04-06T03:25:01.569 INFO:teuthology.orchestra.run.smithi102.stdout:(15/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-04-06T03:25:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-04-06T03:25:01.843 INFO:teuthology.orchestra.run.smithi102.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 316 kB/s | 42 kB 00:00 2024-04-06T03:25:02.371 INFO:teuthology.orchestra.run.smithi047.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 105 kB/s | 107 kB 00:01 2024-04-06T03:25:02.518 INFO:teuthology.orchestra.run.smithi102.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 327 kB/s | 221 kB 00:00 2024-04-06T03:25:02.530 INFO:teuthology.orchestra.run.smithi047.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 139 kB/s | 160 kB 00:01 2024-04-06T03:25:02.652 INFO:teuthology.orchestra.run.smithi102.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 269 kB/s | 36 kB 00:00 2024-04-06T03:25:02.794 INFO:teuthology.orchestra.run.smithi102.stdout:(20/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 334 kB/s | 47 kB 00:00 2024-04-06T03:25:03.144 INFO:teuthology.orchestra.run.smithi102.stdout:(21/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 883 kB/s | 309 kB 00:00 2024-04-06T03:25:03.238 INFO:teuthology.orchestra.run.smithi047.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 52 kB/s | 45 kB 00:00 2024-04-06T03:25:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 228 kB/s | 292 kB 00:01 2024-04-06T03:25:04.536 INFO:teuthology.orchestra.run.smithi102.stdout:(22/32): libarrow-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-04-06T03:25:04.586 INFO:teuthology.orchestra.run.smithi102.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-04-06T03:25:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 319 kB/s | 662 kB 00:02 2024-04-06T03:25:04.645 INFO:teuthology.orchestra.run.smithi102.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 835 kB/s | 49 kB 00:00 2024-04-06T03:25:04.695 INFO:teuthology.orchestra.run.smithi102.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-06T03:25:04.870 INFO:teuthology.orchestra.run.smithi102.stdout:(26/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2024-04-06T03:25:04.921 INFO:teuthology.orchestra.run.smithi102.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-04-06T03:25:05.046 INFO:teuthology.orchestra.run.smithi102.stdout:(28/32): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-06T03:25:05.239 INFO:teuthology.orchestra.run.smithi047.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 59 kB/s | 42 kB 00:00 2024-04-06T03:25:05.330 INFO:teuthology.orchestra.run.smithi102.stdout:(29/32): librados2-19.0.0-2027.g9f192350.el9.x8 12 MB/s | 3.4 MB 00:00 2024-04-06T03:25:05.513 INFO:teuthology.orchestra.run.smithi102.stdout:(30/32): librbd1-19.0.0-2027.g9f192350.el9.x86_ 17 MB/s | 3.1 MB 00:00 2024-04-06T03:25:05.656 INFO:teuthology.orchestra.run.smithi047.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 210 kB/s | 221 kB 00:01 2024-04-06T03:25:05.940 INFO:teuthology.orchestra.run.smithi047.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 51 kB/s | 36 kB 00:00 2024-04-06T03:25:06.182 INFO:teuthology.orchestra.run.smithi047.stdout:(21/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.3 MB/s | 309 kB 00:00 2024-04-06T03:25:06.290 INFO:teuthology.orchestra.run.smithi047.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-04-06T03:25:06.449 INFO:teuthology.orchestra.run.smithi047.stdout:(23/32): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-04-06T03:25:06.474 INFO:teuthology.orchestra.run.smithi047.stdout:(24/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 142 kB/s | 26 kB 00:00 2024-04-06T03:25:06.488 INFO:teuthology.orchestra.run.smithi102.stdout:(31/32): ceph-base-19.0.0-2027.g9f192350.el9.x8 666 kB/s | 5.3 MB 00:08 2024-04-06T03:25:06.508 INFO:teuthology.orchestra.run.smithi047.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-04-06T03:25:06.574 INFO:teuthology.orchestra.run.smithi047.stdout:(26/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-04-06T03:25:06.591 INFO:teuthology.orchestra.run.smithi047.stdout:(27/32): libunwind-1.6.2-1.el9.x86_64.rpm 575 kB/s | 67 kB 00:00 2024-04-06T03:25:06.633 INFO:teuthology.orchestra.run.smithi047.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-06T03:25:06.917 INFO:teuthology.orchestra.run.smithi047.stdout:(29/32): librados2-19.0.0-2027.g9f192350.el9.x8 12 MB/s | 3.4 MB 00:00 2024-04-06T03:25:06.951 INFO:teuthology.orchestra.run.smithi047.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2024-04-06T03:25:07.126 INFO:teuthology.orchestra.run.smithi047.stdout:(31/32): librbd1-19.0.0-2027.g9f192350.el9.x86_ 15 MB/s | 3.1 MB 00:00 2024-04-06T03:25:07.385 INFO:teuthology.orchestra.run.smithi047.stdout:(32/32): ceph-radosgw-19.0.0-2027.g9f192350.el9 1.2 MB/s | 9.8 MB 00:08 2024-04-06T03:25:07.388 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:25:07.388 INFO:teuthology.orchestra.run.smithi047.stdout:Total 6.6 MB/s | 59 MB 00:08 2024-04-06T03:25:07.483 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:25:07.523 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:25:07.523 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:25:08.021 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:25:08.021 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:25:09.205 INFO:teuthology.orchestra.run.smithi102.stdout:(32/32): ceph-common-19.0.0-2027.g9f192350.el9. 1.9 MB/s | 21 MB 00:10 2024-04-06T03:25:09.209 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:25:09.209 INFO:teuthology.orchestra.run.smithi102.stdout:Total 5.2 MB/s | 59 MB 00:11 2024-04-06T03:25:09.307 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:25:09.343 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:25:09.343 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:25:09.532 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:25:09.617 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-06T03:25:09.682 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-06T03:25:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-06T03:25:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-06T03:25:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-06T03:25:09.866 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:25:09.867 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:25:09.943 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-06T03:25:10.002 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-06T03:25:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-06T03:25:10.449 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.0.0-2027.g9f192350.el9.x86_64 7/34 2024-04-06T03:25:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.0.0-2027.g9f192350.el9.x86_64 7/34 2024-04-06T03:25:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.0.0-2027.g9f192350.el9.x86_64 8/34 2024-04-06T03:25:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 9/34 2024-04-06T03:25:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 9/34 2024-04-06T03:25:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-06T03:25:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.0.0-2027.g9f192350.el9. 11/34 2024-04-06T03:25:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.0.0-2027.g9f192350.el9.x86_64 12/34 2024-04-06T03:25:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.0.0-2027.g9f192350.el9.x86_6 13/34 2024-04-06T03:25:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2027.g9f192350.el9.x86_6 13/34 2024-04-06T03:25:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-06T03:25:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-06T03:25:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-06T03:25:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-06T03:25:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-06T03:25:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-06T03:25:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-06T03:25:11.324 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:25:11.405 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-06T03:25:11.435 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-06T03:25:11.468 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-06T03:25:11.491 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-06T03:25:11.508 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-06T03:25:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 22/34 2024-04-06T03:25:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 22/34 2024-04-06T03:25:11.700 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-06T03:25:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.0.0-2027.g9f192350.el9.x86_64 23/34 2024-04-06T03:25:11.755 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-06T03:25:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-06T03:25:12.079 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-06T03:25:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.0.0-2027.g9f192350.el9.x86_64 7/34 2024-04-06T03:25:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.0.0-2027.g9f192350.el9.x86_64 7/34 2024-04-06T03:25:12.248 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-06T03:25:12.278 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.0.0-2027.g9f192350.el9.x86_64 26/34 2024-04-06T03:25:12.333 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.0.0-2027.g9f192350.el9.x86_64 26/34 2024-04-06T03:25:12.334 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.0.0-2027.g9f192350.el9.x86_64 8/34 2024-04-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.0.0-2027.g9f192350.el9.x86_64 27/34 2024-04-06T03:25:12.422 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 9/34 2024-04-06T03:25:12.447 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.0.0-2027.g9f192350.el9.x8 28/34 2024-04-06T03:25:12.476 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 9/34 2024-04-06T03:25:12.509 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-06T03:25:12.549 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.0.0-2027.g9f192350.el9. 11/34 2024-04-06T03:25:12.610 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.0.0-2027.g9f192350.el9.x86_64 12/34 2024-04-06T03:25:12.632 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.0.0-2027.g9f192350.el9.x86_6 13/34 2024-04-06T03:25:12.705 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2027.g9f192350.el9.x86_6 13/34 2024-04-06T03:25:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-06T03:25:12.850 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-06T03:25:12.891 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-06T03:25:12.931 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-06T03:25:12.963 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-06T03:25:12.993 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-06T03:25:13.025 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-06T03:25:13.355 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-06T03:25:13.380 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 22/34 2024-04-06T03:25:13.460 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 22/34 2024-04-06T03:25:13.493 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.0.0-2027.g9f192350.el9.x86_64 23/34 2024-04-06T03:25:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-06T03:25:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-06T03:25:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.0.0-2027.g9f192350.el9.x86_64 26/34 2024-04-06T03:25:14.078 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.0.0-2027.g9f192350.el9.x86_64 26/34 2024-04-06T03:25:14.147 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.0.0-2027.g9f192350.el9.x86_64 27/34 2024-04-06T03:25:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.0.0-2027.g9f192350.el9.x8 28/34 2024-04-06T03:25:14.804 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 29/34 2024-04-06T03:25:14.843 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 29/34 2024-04-06T03:25:15.426 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 29/34 2024-04-06T03:25:15.472 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 30/34 2024-04-06T03:25:15.569 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 30/34 2024-04-06T03:25:15.569 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-06T03:25:15.569 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-06T03:25:15.569 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:15.607 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.0.0-2027.g9f192350.el9.x86_64 31/34 2024-04-06T03:25:16.650 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 29/34 2024-04-06T03:25:16.682 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 29/34 2024-04-06T03:25:17.227 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 29/34 2024-04-06T03:25:17.268 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 30/34 2024-04-06T03:25:17.358 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 30/34 2024-04-06T03:25:17.358 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-06T03:25:17.358 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-06T03:25:17.358 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:17.386 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.0.0-2027.g9f192350.el9.x86_64 31/34 2024-04-06T03:25:25.377 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2027.g9f192350.el9.x86_64 31/34 2024-04-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-04-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-04-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-04-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-04-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-04-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-04-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-04-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:26.332 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.0.0-2027.g9f192350.el9.x86_64 32/34 2024-04-06T03:25:26.356 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2027.g9f192350.el9.x86_64 32/34 2024-04-06T03:25:26.356 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:26.356 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-06T03:25:26.356 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-06T03:25:26.356 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-06T03:25:26.356 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:26.362 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-06T03:25:26.451 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-06T03:25:26.452 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-06T03:25:26.845 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2027.g9f192350.el9.x86_64 31/34 2024-04-06T03:25:26.845 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-04-06T03:25:26.845 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-04-06T03:25:26.845 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-04-06T03:25:26.846 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-04-06T03:25:26.846 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-04-06T03:25:26.846 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-04-06T03:25:26.846 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-04-06T03:25:26.846 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-06T03:25:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 1/34 2024-04-06T03:25:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 2/34 2024-04-06T03:25:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.0.0-2027.g9f192350.el9.x86_64 3/34 2024-04-06T03:25:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.0.0-2027.g9f192350.el9.x86_64 4/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 5/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.0.0-2027.g9f192350.el9.x86_6 6/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.0.0-2027.g9f192350.el9.x86_64 7/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2027.g9f192350.el9. 8/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.0.0-2027.g9f192350.el9.x8 9/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.0.0-2027.g9f192350.el9.x86_64 10/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.0.0-2027.g9f192350.el9.x86_64 11/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.0.0-2027.g9f192350.el9.x86_64 12/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.0.0-2027.g9f192350.el9.x86_64 13/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-06T03:25:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-06T03:25:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-06T03:25:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-06T03:25:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-06T03:25:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.0.0-2027.g9f192350.el9.x86_64 31/34 2024-04-06T03:25:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-06T03:25:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 33/34 2024-04-06T03:25:27.777 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.0.0-2027.g9f192350.el9.x86_64 32/34 2024-04-06T03:25:27.806 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2027.g9f192350.el9.x86_64 32/34 2024-04-06T03:25:27.806 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:27.806 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-06T03:25:27.806 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-06T03:25:27.806 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-06T03:25:27.807 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:27.808 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-06T03:25:27.878 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-06T03:25:27.878 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.749 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-06T03:25:28.750 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-06T03:25:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-06T03:25:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-06T03:25:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-06T03:25:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-06T03:25:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-3.el9.x86_64 2024-04-06T03:25:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-06T03:25:28.752 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:28.752 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 1/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 2/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.0.0-2027.g9f192350.el9.x86_64 3/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.0.0-2027.g9f192350.el9.x86_64 4/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 5/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.0.0-2027.g9f192350.el9.x86_6 6/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.0.0-2027.g9f192350.el9.x86_64 7/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2027.g9f192350.el9. 8/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.0.0-2027.g9f192350.el9.x8 9/34 2024-04-06T03:25:29.000 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.0.0-2027.g9f192350.el9.x86_64 10/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.0.0-2027.g9f192350.el9.x86_64 11/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.0.0-2027.g9f192350.el9.x86_64 12/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.0.0-2027.g9f192350.el9.x86_64 13/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-06T03:25:29.001 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.0.0-2027.g9f192350.el9.x86_64 31/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-06T03:25:29.002 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 33/34 2024-04-06T03:25:29.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-test 2024-04-06T03:25:29.704 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:34 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:25:30.008 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:25:30.008 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:25:30.008 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:25:30.009 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.010 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:25:30.011 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:25:30.012 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:25:30.013 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.014 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.015 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.016 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.017 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:25:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:25:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:30.091 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:25:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:25:30.091 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.0.0-2027.g9f192350.el9 ceph 48 M 2024-04-06T03:25:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:25:30.091 INFO:teuthology.orchestra.run.smithi047.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-06T03:25:30.091 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.0.0-2027.g9f192350.el9 ceph 163 k 2024-04-06T03:25:30.092 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-06T03:25:30.092 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-06T03:25:30.092 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-06T03:25:30.092 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:25:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:Install 6 Packages 2024-04-06T03:25:30.092 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 48 M 2024-04-06T03:25:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 205 M 2024-04-06T03:25:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:25:30.132 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-06T03:25:30.132 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:30.132 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-04-06T03:25:30.132 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-06T03:25:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-06T03:25:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-06T03:25:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-06T03:25:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-3.el9.x86_64 2024-04-06T03:25:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-06T03:25:30.136 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:30.136 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:25:30.474 INFO:teuthology.orchestra.run.smithi047.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2024-04-06T03:25:30.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-test 2024-04-06T03:25:30.532 INFO:teuthology.orchestra.run.smithi047.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 218 kB 00:00 2024-04-06T03:25:30.574 INFO:teuthology.orchestra.run.smithi047.stdout:(3/6): libcephsqlite-19.0.0-2027.g9f192350.el9. 673 kB/s | 163 kB 00:00 2024-04-06T03:25:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-04-06T03:25:30.707 INFO:teuthology.orchestra.run.smithi047.stdout:(5/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.7 MB/s | 305 kB 00:00 2024-04-06T03:25:31.083 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:37 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:25:31.371 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:25:31.371 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:25:31.371 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:25:31.371 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.371 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.372 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:25:31.373 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:25:31.374 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:25:31.375 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:25:31.376 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.377 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.378 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:25:31.379 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.380 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.380 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.380 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.380 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:25:31.380 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.380 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.380 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.380 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:25:31.443 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:25:31.444 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:25:31.444 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:25:31.444 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:25:31.444 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:25:31.444 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.0.0-2027.g9f192350.el9 ceph 48 M 2024-04-06T03:25:31.444 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:25:31.444 INFO:teuthology.orchestra.run.smithi102.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-06T03:25:31.444 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.0.0-2027.g9f192350.el9 ceph 163 k 2024-04-06T03:25:31.445 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-06T03:25:31.445 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-06T03:25:31.445 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-06T03:25:31.445 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:31.445 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:25:31.445 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:25:31.445 INFO:teuthology.orchestra.run.smithi102.stdout:Install 6 Packages 2024-04-06T03:25:31.445 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:31.446 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 48 M 2024-04-06T03:25:31.446 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 205 M 2024-04-06T03:25:31.446 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:25:31.926 INFO:teuthology.orchestra.run.smithi102.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 917 kB/s | 187 kB 00:00 2024-04-06T03:25:32.042 INFO:teuthology.orchestra.run.smithi102.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.8 MB/s | 218 kB 00:00 2024-04-06T03:25:32.201 INFO:teuthology.orchestra.run.smithi102.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 305 kB 00:00 2024-04-06T03:25:32.251 INFO:teuthology.orchestra.run.smithi102.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-06T03:25:32.276 INFO:teuthology.orchestra.run.smithi102.stdout:(5/6): libcephsqlite-19.0.0-2027.g9f192350.el9. 294 kB/s | 163 kB 00:00 2024-04-06T03:25:33.250 INFO:teuthology.orchestra.run.smithi047.stdout:(6/6): ceph-test-19.0.0-2027.g9f192350.el9.x86_ 16 MB/s | 48 MB 00:02 2024-04-06T03:25:33.252 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:25:33.252 INFO:teuthology.orchestra.run.smithi047.stdout:Total 15 MB/s | 48 MB 00:03 2024-04-06T03:25:33.302 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:25:33.324 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:25:33.324 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:25:33.746 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:25:33.746 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:25:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:25:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-06T03:25:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-06T03:25:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-06T03:25:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-06T03:25:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.0.0-2027.g9f192350.el9.x86_64 5/6 2024-04-06T03:25:36.035 INFO:teuthology.orchestra.run.smithi102.stdout:(6/6): ceph-test-19.0.0-2027.g9f192350.el9.x86_ 11 MB/s | 48 MB 00:04 2024-04-06T03:25:36.037 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:25:36.037 INFO:teuthology.orchestra.run.smithi102.stdout:Total 11 MB/s | 48 MB 00:04 2024-04-06T03:25:36.086 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:25:36.105 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:25:36.105 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:25:36.509 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:25:36.510 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:25:37.097 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:25:37.169 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-06T03:25:37.219 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-06T03:25:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-06T03:25:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-06T03:25:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.0.0-2027.g9f192350.el9.x86_64 5/6 2024-04-06T03:25:39.302 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2027.g9f192350.el9.x86_64 5/6 2024-04-06T03:25:39.388 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.0.0-2027.g9f192350.el9.x86_64 6/6 2024-04-06T03:25:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-test-2:19.0.0-2027.g9f192350.el9.x86_64 6/6 2024-04-06T03:25:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.0.0-2027.g9f192350.el9.x86_64 1/6 2024-04-06T03:25:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.0.0-2027.g9f192350.el9.x86_64 2/6 2024-04-06T03:25:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-04-06T03:25:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-04-06T03:25:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-04-06T03:25:41.781 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2027.g9f192350.el9.x86_64 5/6 2024-04-06T03:25:41.862 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.0.0-2027.g9f192350.el9.x86_64 6/6 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: jq-1.6-16.el9.x86_64 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-06T03:25:42.030 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:42.031 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:25:42.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph 2024-04-06T03:25:42.923 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:47 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:25:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:25:43.225 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:25:43.225 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:25:43.225 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.225 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:25:43.225 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.225 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:25:43.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:25:43.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:25:43.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.234 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:25:43.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:25:43.301 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:25:43.304 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:43.304 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:25:43.304 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:43.304 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:25:43.304 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.0.0-2027.g9f192350.el9 ceph 6.6 k 2024-04-06T03:25:43.304 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.0.0-2027.g9f192350.el9 ceph 2.4 M 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.0.0-2027.g9f192350.el9 ceph 1.5 M 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 248 k 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.0.0-2027.g9f192350.el9 ceph 4.7 M 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.0.0-2027.g9f192350.el9 ceph 17 M 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-06T03:25:43.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-06T03:25:43.306 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:25:43.307 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:43.308 INFO:teuthology.orchestra.run.smithi047.stdout:Install 36 Packages 2024-04-06T03:25:43.308 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:43.308 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 30 M 2024-04-06T03:25:43.308 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 107 M 2024-04-06T03:25:43.308 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:25:44.154 INFO:teuthology.orchestra.run.smithi047.stdout:(1/36): ceph-19.0.0-2027.g9f192350.el9.x86_64.r 37 kB/s | 6.6 kB 00:00 2024-04-06T03:25:44.313 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-test-2:19.0.0-2027.g9f192350.el9.x86_64 6/6 2024-04-06T03:25:44.313 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.0.0-2027.g9f192350.el9.x86_64 1/6 2024-04-06T03:25:44.313 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.0.0-2027.g9f192350.el9.x86_64 2/6 2024-04-06T03:25:44.313 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-04-06T03:25:44.314 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-04-06T03:25:44.314 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-04-06T03:25:44.354 INFO:teuthology.orchestra.run.smithi047.stdout:(2/36): ceph-mgr-19.0.0-2027.g9f192350.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-04-06T03:25:44.654 INFO:teuthology.orchestra.run.smithi047.stdout:(3/36): ceph-mon-19.0.0-2027.g9f192350.el9.x86_ 9.4 MB/s | 4.7 MB 00:00 2024-04-06T03:25:44.682 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-04-06T03:25:44.682 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:44.682 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:25:44.683 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:44.683 INFO:teuthology.orchestra.run.smithi102.stdout: jq-1.6-16.el9.x86_64 2024-04-06T03:25:44.683 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:44.683 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-06T03:25:44.683 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-06T03:25:44.683 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-06T03:25:44.683 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:44.683 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:25:44.721 INFO:teuthology.orchestra.run.smithi047.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2027.g9f19 3.7 MB/s | 248 kB 00:00 2024-04-06T03:25:44.863 INFO:teuthology.orchestra.run.smithi047.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-04-06T03:25:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:(6/36): ceph-mds-19.0.0-2027.g9f192350.el9.x86_ 2.5 MB/s | 2.4 MB 00:00 2024-04-06T03:25:44.989 INFO:teuthology.orchestra.run.smithi047.stdout:(7/36): python3-cryptography-36.0.1-4.el9.x86_6 9.8 MB/s | 1.2 MB 00:00 2024-04-06T03:25:45.016 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph 2024-04-06T03:25:45.055 INFO:teuthology.orchestra.run.smithi047.stdout:(8/36): python3-ply-3.11-14.el9.noarch.rpm 750 kB/s | 106 kB 00:00 2024-04-06T03:25:45.081 INFO:teuthology.orchestra.run.smithi047.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.4 MB/s | 135 kB 00:00 2024-04-06T03:25:45.115 INFO:teuthology.orchestra.run.smithi047.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-04-06T03:25:45.140 INFO:teuthology.orchestra.run.smithi047.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-04-06T03:25:45.182 INFO:teuthology.orchestra.run.smithi047.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-06T03:25:45.207 INFO:teuthology.orchestra.run.smithi047.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-06T03:25:45.224 INFO:teuthology.orchestra.run.smithi047.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 832 kB/s | 35 kB 00:00 2024-04-06T03:25:45.391 INFO:teuthology.orchestra.run.smithi047.stdout:(15/36): ceph-osd-19.0.0-2027.g9f192350.el9.x86 16 MB/s | 17 MB 00:01 2024-04-06T03:25:45.416 INFO:teuthology.orchestra.run.smithi047.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 217 kB/s | 42 kB 00:00 2024-04-06T03:25:45.441 INFO:teuthology.orchestra.run.smithi047.stdout:(17/36): python3-pytz-2021.1-5.el9.noarch.rpm 218 kB/s | 51 kB 00:00 2024-04-06T03:25:45.600 INFO:teuthology.orchestra.run.smithi047.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 274 kB/s | 43 kB 00:00 2024-04-06T03:25:45.618 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:51 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:25:45.675 INFO:teuthology.orchestra.run.smithi047.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 584 kB/s | 151 kB 00:00 2024-04-06T03:25:45.701 INFO:teuthology.orchestra.run.smithi047.stdout:(20/36): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-04-06T03:25:45.726 INFO:teuthology.orchestra.run.smithi047.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-06T03:25:45.793 INFO:teuthology.orchestra.run.smithi047.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 454 kB/s | 18 kB 00:00 2024-04-06T03:25:45.818 INFO:teuthology.orchestra.run.smithi047.stdout:(23/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2024-04-06T03:25:45.844 INFO:teuthology.orchestra.run.smithi047.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 472 kB/s | 23 kB 00:00 2024-04-06T03:25:45.869 INFO:teuthology.orchestra.run.smithi047.stdout:(25/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 64 kB/s | 11 kB 00:00 2024-04-06T03:25:45.894 INFO:teuthology.orchestra.run.smithi047.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-04-06T03:25:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:25:45.905 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:25:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:25:45.910 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.911 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:25:45.912 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:25:45.922 INFO:teuthology.orchestra.run.smithi047.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-04-06T03:25:45.945 INFO:teuthology.orchestra.run.smithi047.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-04-06T03:25:45.970 INFO:teuthology.orchestra.run.smithi047.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-06T03:25:45.987 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.0.0-2027.g9f192350.el9 ceph 6.6 k 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.0.0-2027.g9f192350.el9 ceph 2.4 M 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.0.0-2027.g9f192350.el9 ceph 1.5 M 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 248 k 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.0.0-2027.g9f192350.el9 ceph 4.7 M 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.0.0-2027.g9f192350.el9 ceph 17 M 2024-04-06T03:25:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-06T03:25:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-06T03:25:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-06T03:25:45.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-06T03:25:45.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-06T03:25:45.993 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:45.993 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:25:45.993 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:25:45.993 INFO:teuthology.orchestra.run.smithi102.stdout:Install 36 Packages 2024-04-06T03:25:45.993 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:45.993 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 30 M 2024-04-06T03:25:45.994 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 107 M 2024-04-06T03:25:45.994 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:25:45.995 INFO:teuthology.orchestra.run.smithi047.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-04-06T03:25:46.028 INFO:teuthology.orchestra.run.smithi047.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-04-06T03:25:46.054 INFO:teuthology.orchestra.run.smithi047.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 613 kB/s | 36 kB 00:00 2024-04-06T03:25:46.079 INFO:teuthology.orchestra.run.smithi047.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-04-06T03:25:46.121 INFO:teuthology.orchestra.run.smithi047.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 482 kB/s | 20 kB 00:00 2024-04-06T03:25:46.146 INFO:teuthology.orchestra.run.smithi047.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-06T03:25:46.196 INFO:teuthology.orchestra.run.smithi047.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2024-04-06T03:25:46.201 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:25:46.201 INFO:teuthology.orchestra.run.smithi047.stdout:Total 10 MB/s | 30 MB 00:02 2024-04-06T03:25:46.341 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:25:46.384 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:25:46.384 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:25:46.423 INFO:teuthology.orchestra.run.smithi102.stdout:(1/36): ceph-19.0.0-2027.g9f192350.el9.x86_64.r 41 kB/s | 6.6 kB 00:00 2024-04-06T03:25:46.691 INFO:teuthology.orchestra.run.smithi102.stdout:(2/36): ceph-mgr-19.0.0-2027.g9f192350.el9.x86_ 3.5 MB/s | 1.5 MB 00:00 2024-04-06T03:25:46.807 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:25:46.808 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:25:46.866 INFO:teuthology.orchestra.run.smithi102.stdout:(3/36): ceph-mon-19.0.0-2027.g9f192350.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-04-06T03:25:46.933 INFO:teuthology.orchestra.run.smithi102.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2027.g9f19 3.7 MB/s | 248 kB 00:00 2024-04-06T03:25:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-04-06T03:25:47.192 INFO:teuthology.orchestra.run.smithi102.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 11 MB/s | 1.2 MB 00:00 2024-04-06T03:25:47.259 INFO:teuthology.orchestra.run.smithi102.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-06T03:25:47.300 INFO:teuthology.orchestra.run.smithi102.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-04-06T03:25:47.342 INFO:teuthology.orchestra.run.smithi102.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-04-06T03:25:47.384 INFO:teuthology.orchestra.run.smithi102.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 5.0 MB/s | 215 kB 00:00 2024-04-06T03:25:47.602 INFO:teuthology.orchestra.run.smithi102.stdout:(11/36): ceph-osd-19.0.0-2027.g9f192350.el9.x86 18 MB/s | 17 MB 00:00 2024-04-06T03:25:47.652 INFO:teuthology.orchestra.run.smithi102.stdout:(12/36): ceph-mds-19.0.0-2027.g9f192350.el9.x86 1.7 MB/s | 2.4 MB 00:01 2024-04-06T03:25:47.741 INFO:teuthology.orchestra.run.smithi102.stdout:(13/36): lua-5.4.4-4.el9.x86_64.rpm 529 kB/s | 188 kB 00:00 2024-04-06T03:25:47.761 INFO:teuthology.orchestra.run.smithi102.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-04-06T03:25:47.777 INFO:teuthology.orchestra.run.smithi102.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 51 kB 00:00 2024-04-06T03:25:47.819 INFO:teuthology.orchestra.run.smithi102.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-04-06T03:25:47.845 INFO:teuthology.orchestra.run.smithi102.stdout:(17/36): python3-mako-1.1.4-6.el9.noarch.rpm 710 kB/s | 172 kB 00:00 2024-04-06T03:25:47.862 INFO:teuthology.orchestra.run.smithi102.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 265 kB/s | 22 kB 00:00 2024-04-06T03:25:48.145 INFO:teuthology.orchestra.run.smithi102.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 145 kB/s | 43 kB 00:00 2024-04-06T03:25:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:25:48.212 INFO:teuthology.orchestra.run.smithi102.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 385 kB/s | 151 kB 00:00 2024-04-06T03:25:48.250 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-06T03:25:48.254 INFO:teuthology.orchestra.run.smithi102.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 438 kB/s | 172 kB 00:00 2024-04-06T03:25:48.284 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-06T03:25:48.296 INFO:teuthology.orchestra.run.smithi102.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-04-06T03:25:48.310 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-06T03:25:48.338 INFO:teuthology.orchestra.run.smithi102.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 211 kB/s | 18 kB 00:00 2024-04-06T03:25:48.380 INFO:teuthology.orchestra.run.smithi102.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 277 kB/s | 23 kB 00:00 2024-04-06T03:25:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-06T03:25:48.422 INFO:teuthology.orchestra.run.smithi102.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 232 kB/s | 19 kB 00:00 2024-04-06T03:25:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-06T03:25:48.459 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-06T03:25:48.464 INFO:teuthology.orchestra.run.smithi102.stdout:(26/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-04-06T03:25:48.481 INFO:teuthology.orchestra.run.smithi102.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 195 kB/s | 20 kB 00:00 2024-04-06T03:25:48.515 INFO:teuthology.orchestra.run.smithi102.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 501 kB/s | 46 kB 00:00 2024-04-06T03:25:48.548 INFO:teuthology.orchestra.run.smithi102.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 941 kB/s | 79 kB 00:00 2024-04-06T03:25:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-06T03:25:48.624 INFO:teuthology.orchestra.run.smithi102.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2024-04-06T03:25:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-06T03:25:48.666 INFO:teuthology.orchestra.run.smithi102.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-04-06T03:25:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-06T03:25:48.691 INFO:teuthology.orchestra.run.smithi102.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 632 kB/s | 90 kB 00:00 2024-04-06T03:25:48.707 INFO:teuthology.orchestra.run.smithi102.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 428 kB/s | 36 kB 00:00 2024-04-06T03:25:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-06T03:25:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-06T03:25:48.766 INFO:teuthology.orchestra.run.smithi102.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-06T03:25:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-06T03:25:48.808 INFO:teuthology.orchestra.run.smithi102.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 199 kB/s | 20 kB 00:00 2024-04-06T03:25:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-06T03:25:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-06T03:25:48.875 INFO:teuthology.orchestra.run.smithi102.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2024-04-06T03:25:48.877 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:25:48.877 INFO:teuthology.orchestra.run.smithi102.stdout:Total 10 MB/s | 30 MB 00:02 2024-04-06T03:25:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-06T03:25:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-06T03:25:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-06T03:25:49.015 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:25:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-06T03:25:49.054 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:25:49.054 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:25:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-06T03:25:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-06T03:25:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-06T03:25:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-06T03:25:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-06T03:25:49.487 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:25:49.487 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:25:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-06T03:25:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-06T03:25:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-06T03:25:49.811 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-06T03:25:49.900 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-06T03:25:49.946 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-06T03:25:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-06T03:25:50.250 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2027.g9f192350.el9. 31/36 2024-04-06T03:25:50.280 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 32/36 2024-04-06T03:25:50.305 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 32/36 2024-04-06T03:25:50.305 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:50.305 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-06T03:25:50.305 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-06T03:25:50.305 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-06T03:25:50.305 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:50.822 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:25:50.877 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-06T03:25:50.911 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-06T03:25:50.938 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-06T03:25:51.008 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-06T03:25:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-06T03:25:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-06T03:25:51.177 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-06T03:25:51.265 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-06T03:25:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-06T03:25:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-06T03:25:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-06T03:25:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-06T03:25:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-06T03:25:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-06T03:25:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-06T03:25:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-06T03:25:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-06T03:25:51.700 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-06T03:25:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.0.0-2027.g9f192350.el9.x86_64 33/36 2024-04-06T03:25:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-06T03:25:51.857 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.0.0-2027.g9f192350.el9.x86_64 33/36 2024-04-06T03:25:51.857 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:51.857 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-06T03:25:51.857 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-06T03:25:51.857 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-06T03:25:51.857 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-06T03:25:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-06T03:25:52.011 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-06T03:25:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-06T03:25:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-06T03:25:52.299 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-06T03:25:52.315 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.0.0-2027.g9f192350.el9.x86_64 34/36 2024-04-06T03:25:52.338 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.0.0-2027.g9f192350.el9.x86_64 34/36 2024-04-06T03:25:52.338 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:52.338 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-06T03:25:52.338 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-06T03:25:52.338 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-06T03:25:52.338 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:52.349 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-06T03:25:52.426 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-06T03:25:52.514 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-06T03:25:52.554 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-06T03:25:52.573 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.0.0-2027.g9f192350.el9.x86_64 35/36 2024-04-06T03:25:52.596 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.0.0-2027.g9f192350.el9.x86_64 35/36 2024-04-06T03:25:52.596 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:52.596 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-06T03:25:52.596 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-06T03:25:52.596 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-06T03:25:52.596 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.0.0-2027.g9f192350.el9.x86_64 36/36 2024-04-06T03:25:52.679 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-06T03:25:52.858 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2027.g9f192350.el9. 31/36 2024-04-06T03:25:52.884 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 32/36 2024-04-06T03:25:52.909 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 32/36 2024-04-06T03:25:52.910 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:52.910 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-06T03:25:52.910 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-06T03:25:52.910 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-06T03:25:52.910 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-2:19.0.0-2027.g9f192350.el9.x86_64 36/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.0.0-2027.g9f192350.el9.x86_64 1/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.0.0-2027.g9f192350.el9.x86_64 2/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 3/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.0.0-2027.g9f192350.el9.x86_64 4/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.0.0-2027.g9f192350.el9.x86_64 5/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2027.g9f192350.el9. 6/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-06T03:25:54.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-06T03:25:54.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-06T03:25:54.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-06T03:25:54.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-06T03:25:54.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-06T03:25:54.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-06T03:25:54.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-06T03:25:54.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-06T03:25:54.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-06T03:25:54.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-06T03:25:54.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-06T03:25:54.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-06T03:25:54.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-06T03:25:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.0.0-2027.g9f192350.el9.x86_64 33/36 2024-04-06T03:25:54.394 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.0.0-2027.g9f192350.el9.x86_64 33/36 2024-04-06T03:25:54.394 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:54.395 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-06T03:25:54.395 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-06T03:25:54.395 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-06T03:25:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:54.844 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.0.0-2027.g9f192350.el9.x86_64 34/36 2024-04-06T03:25:54.867 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.0.0-2027.g9f192350.el9.x86_64 34/36 2024-04-06T03:25:54.867 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:54.868 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-06T03:25:54.868 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-06T03:25:54.868 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-06T03:25:54.868 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:55.086 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.0.0-2027.g9f192350.el9.x86_64 35/36 2024-04-06T03:25:55.109 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.0.0-2027.g9f192350.el9.x86_64 35/36 2024-04-06T03:25:55.109 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:25:55.109 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-06T03:25:55.110 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-06T03:25:55.110 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-06T03:25:55.110 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:55.175 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.0.0-2027.g9f192350.el9.x86_64 36/36 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:55.436 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-06T03:25:55.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-06T03:25:55.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-06T03:25:55.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-06T03:25:55.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-06T03:25:55.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-06T03:25:55.439 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:55.439 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:25:55.676 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-base 2024-04-06T03:25:56.282 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:01 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.584 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.585 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:25:56.586 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.587 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:25:56.588 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:25:56.589 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.590 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.591 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:25:56.592 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:25:56.593 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:25:56.655 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:25:56.656 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:25:56.656 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:25:56.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install cephadm 2024-04-06T03:25:56.896 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-2:19.0.0-2027.g9f192350.el9.x86_64 36/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.0.0-2027.g9f192350.el9.x86_64 1/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.0.0-2027.g9f192350.el9.x86_64 2/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 3/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.0.0-2027.g9f192350.el9.x86_64 4/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.0.0-2027.g9f192350.el9.x86_64 5/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2027.g9f192350.el9. 6/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-06T03:25:56.897 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-06T03:25:56.898 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-06T03:25:56.899 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-06T03:25:56.899 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-06T03:25:56.899 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-06T03:25:56.899 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-06T03:25:56.899 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-06T03:25:56.899 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-06T03:25:56.899 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-06T03:25:56.899 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-06T03:25:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:02 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.629 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:25:57.630 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:25:57.631 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:25:57.632 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.633 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.634 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:25:57.635 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.636 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.637 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:25:57.699 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:25:57.700 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:25:57.700 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:57.700 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:25:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 749 k 2024-04-06T03:25:57.700 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:57.701 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:25:57.701 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:25:57.701 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-04-06T03:25:57.701 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:57.701 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 749 k 2024-04-06T03:25:57.701 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 755 k 2024-04-06T03:25:57.701 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:25:57.903 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-06T03:25:57.903 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:57.903 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:25:57.903 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:57.903 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:57.903 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-06T03:25:57.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-06T03:25:57.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-06T03:25:57.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-06T03:25:57.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-06T03:25:57.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-06T03:25:57.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-06T03:25:57.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-06T03:25:57.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-06T03:25:57.906 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:25:57.906 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:25:58.141 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm-19.0.0-2027.g9f192350.el9.noarch.rpm 1.7 MB/s | 749 kB 00:00 2024-04-06T03:25:58.141 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:25:58.141 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.7 MB/s | 749 kB 00:00 2024-04-06T03:25:58.141 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:25:58.147 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:25:58.147 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:25:58.153 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:25:58.153 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:25:58.233 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:25:58.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-base 2024-04-06T03:25:58.683 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/1 2024-04-06T03:25:58.764 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/1 2024-04-06T03:25:58.852 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:04 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:25:59.127 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/1 2024-04-06T03:25:59.141 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:25:59.141 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:25:59.141 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.142 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:25:59.151 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-base-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:25:59.209 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:25:59.210 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:25:59.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install cephadm 2024-04-06T03:25:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/1 2024-04-06T03:25:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:59.445 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:25:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:25:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:25:59.445 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:25:59.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-immutable-object-cache 2024-04-06T03:25:59.879 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:05 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:00.164 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.232 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 749 k 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-04-06T03:26:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:00.234 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 749 k 2024-04-06T03:26:00.234 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 755 k 2024-04-06T03:26:00.234 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:00.236 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:05 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:00.539 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:00.539 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:00.539 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:00.539 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.540 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:00.541 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.542 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.543 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.544 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.545 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:00.546 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.547 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:00.548 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.548 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.548 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.548 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:00.611 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:00.611 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2027.g9f192350.el9 ceph 145 k 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 145 k 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 436 k 2024-04-06T03:26:00.612 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:00.670 INFO:teuthology.orchestra.run.smithi102.stdout:cephadm-19.0.0-2027.g9f192350.el9.noarch.rpm 1.7 MB/s | 749 kB 00:00 2024-04-06T03:26:00.671 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:00.671 INFO:teuthology.orchestra.run.smithi102.stdout:Total 1.7 MB/s | 749 kB 00:00 2024-04-06T03:26:00.672 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:00.677 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:00.677 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:00.682 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:00.683 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:00.813 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-immutable-object-cache-19.0.0-2027.g9f1923 721 kB/s | 145 kB 00:00 2024-04-06T03:26:00.814 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:00.814 INFO:teuthology.orchestra.run.smithi047.stdout:Total 716 kB/s | 145 kB 00:00 2024-04-06T03:26:00.815 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:00.823 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:00.823 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:00.879 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:00.879 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:01.031 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:01.090 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2027.g9f192350. 1/1 2024-04-06T03:26:01.113 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2027.g9f192350. 1/1 2024-04-06T03:26:01.114 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:26:01.114 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-06T03:26:01.114 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:01.212 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/1 2024-04-06T03:26:01.284 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/1 2024-04-06T03:26:01.646 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/1 2024-04-06T03:26:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/1 2024-04-06T03:26:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:01.945 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:01.946 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:02.149 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-immutable-object-cache 2024-04-06T03:26:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2027.g9f192350. 1/1 2024-04-06T03:26:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:02.246 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:26:02.246 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:02.247 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:02.525 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr 2024-04-06T03:26:02.743 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:08 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.034 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.035 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:03.036 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.037 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:03.038 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.039 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.040 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.041 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.042 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.102 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:03.103 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:03.103 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-04-06T03:26:03.103 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:03.103 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:03.103 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2027.g9f192350.el9 ceph 145 k 2024-04-06T03:26:03.103 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:03.103 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:03.103 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:03.104 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-04-06T03:26:03.104 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:03.104 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 145 k 2024-04-06T03:26:03.104 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 436 k 2024-04-06T03:26:03.104 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:03.137 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:08 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:03.352 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-immutable-object-cache-19.0.0-2027.g9f1923 584 kB/s | 145 kB 00:00 2024-04-06T03:26:03.352 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:03.353 INFO:teuthology.orchestra.run.smithi102.stdout:Total 580 kB/s | 145 kB 00:00 2024-04-06T03:26:03.353 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:03.360 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:03.360 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:03.412 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:03.412 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:03.439 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:03.439 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.440 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.441 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.442 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:03.443 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:03.444 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.445 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.446 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.447 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.448 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:03.449 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:03.511 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:03.512 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:26:03.513 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:03.556 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:03.575 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-dashboard 2024-04-06T03:26:03.619 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2027.g9f192350. 1/1 2024-04-06T03:26:03.644 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2027.g9f192350. 1/1 2024-04-06T03:26:03.644 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:26:03.644 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-06T03:26:03.644 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:04.171 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:09 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.478 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.479 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.480 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.481 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.482 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.483 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.484 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.485 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.486 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:04.550 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:26:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:04.550 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 3.5 M 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 32 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 15 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-04-06T03:26:04.552 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 8.6 M 2024-04-06T03:26:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 103 M 2024-04-06T03:26:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:04.609 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2027.g9f192350. 1/1 2024-04-06T03:26:04.609 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:04.609 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:04.610 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:26:04.610 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:04.610 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:04.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr 2024-04-06T03:26:05.159 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): ceph-prometheus-alerts-19.0.0-2027.g9f1 79 kB/s | 15 kB 00:00 2024-04-06T03:26:05.176 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): ceph-grafana-dashboards-19.0.0-2027.g9f 151 kB/s | 32 kB 00:00 2024-04-06T03:26:05.335 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-04-06T03:26:05.385 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-04-06T03:26:05.438 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:11 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:05.577 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): ceph-mgr-dashboard-19.0.0-2027.g9f19235 5.8 MB/s | 3.5 MB 00:00 2024-04-06T03:26:05.710 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.2 MB/s | 863 kB 00:00 2024-04-06T03:26:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:05.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:05.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:05.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:05.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.729 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.732 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.733 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:05.734 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-mgr-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:05.793 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:05.794 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:26:05.794 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-04-06T03:26:05.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-dashboard 2024-04-06T03:26:05.878 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-04-06T03:26:06.003 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 246 kB/s | 31 kB 00:00 2024-04-06T03:26:06.087 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 578 kB/s | 144 kB 00:00 2024-04-06T03:26:06.129 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-04-06T03:26:06.287 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.5 MB/s | 2.0 MB 00:00 2024-04-06T03:26:06.291 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:06.291 INFO:teuthology.orchestra.run.smithi047.stdout:Total 5.0 MB/s | 8.6 MB 00:01 2024-04-06T03:26:06.342 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:06.361 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:06.361 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:06.455 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:12 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:06.568 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:06.568 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:06.742 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:06.743 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.744 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:06.745 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.746 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.747 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.748 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.749 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.750 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.751 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.752 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:06.810 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:06.811 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:06.811 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 3.5 M 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 32 k 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 15 k 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-06T03:26:06.812 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-06T03:26:06.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-06T03:26:06.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-06T03:26:06.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-06T03:26:06.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:06.813 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:06.813 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:06.813 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-04-06T03:26:06.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:06.814 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 8.6 M 2024-04-06T03:26:06.814 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 103 M 2024-04-06T03:26:06.814 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:07.228 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:07.256 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): ceph-prometheus-alerts-19.0.0-2027.g9f1 60 kB/s | 15 kB 00:00 2024-04-06T03:26:07.281 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): ceph-grafana-dashboards-19.0.0-2027.g9f 113 kB/s | 32 kB 00:00 2024-04-06T03:26:07.313 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-06T03:26:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-06T03:26:07.404 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-06T03:26:07.442 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-06T03:26:07.550 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-06T03:26:07.656 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-04-06T03:26:07.687 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-06T03:26:07.723 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 609 kB/s | 269 kB 00:00 2024-04-06T03:26:07.790 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-06T03:26:07.851 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-06T03:26:07.883 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-06T03:26:07.915 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2027.g9f192350.el9 10/12 2024-04-06T03:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.2 MB/s | 548 kB 00:00 2024-04-06T03:26:08.024 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): ceph-mgr-dashboard-19.0.0-2027.g9f19235 3.4 MB/s | 3.5 MB 00:01 2024-04-06T03:26:08.066 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-06T03:26:08.216 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 11 MB/s | 2.0 MB 00:00 2024-04-06T03:26:08.242 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 823 kB/s | 144 kB 00:00 2024-04-06T03:26:08.284 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 459 kB/s | 31 kB 00:00 2024-04-06T03:26:08.309 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-04-06T03:26:08.417 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.1 MB/s | 863 kB 00:00 2024-04-06T03:26:08.420 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:08.420 INFO:teuthology.orchestra.run.smithi102.stdout:Total 5.4 MB/s | 8.6 MB 00:01 2024-04-06T03:26:08.467 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:08.484 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:08.484 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:08.673 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:08.673 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:09.009 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2027.g9f192350.el 11/12 2024-04-06T03:26:09.049 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2027.g9f192350.el9.noa 12/12 2024-04-06T03:26:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-06T03:26:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-06T03:26:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-06T03:26:09.405 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-06T03:26:09.497 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-06T03:26:09.620 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-06T03:26:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-06T03:26:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-06T03:26:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-06T03:26:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2027.g9f192350.el9 10/12 2024-04-06T03:26:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2027.g9f192350.el9.noa 12/12 2024-04-06T03:26:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2027.g9f192350.el 1/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2027.g9f192350.el9.noa 2/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2027.g9f192350.el9 3/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-06T03:26:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-06T03:26:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-06T03:26:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:10.762 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-06T03:26:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:10.763 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:10.861 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2027.g9f192350.el 11/12 2024-04-06T03:26:10.896 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2027.g9f192350.el9.noa 12/12 2024-04-06T03:26:10.980 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-06T03:26:11.579 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:16 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:11.892 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:11.893 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:11.894 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:11.895 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.896 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.897 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.898 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:11.899 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.901 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.902 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:11.966 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 7.4 M 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-06T03:26:11.967 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-04-06T03:26:11.968 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:11.969 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 38 M 2024-04-06T03:26:11.969 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 209 M 2024-04-06T03:26:11.969 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2027.g9f192350.el9.noa 12/12 2024-04-06T03:26:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2027.g9f192350.el 1/12 2024-04-06T03:26:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2027.g9f192350.el9.noa 2/12 2024-04-06T03:26:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2027.g9f192350.el9 3/12 2024-04-06T03:26:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-06T03:26:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-06T03:26:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-06T03:26:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-06T03:26:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-06T03:26:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-06T03:26:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-06T03:26:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-06T03:26:12.628 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-06T03:26:12.633 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-06T03:26:12.633 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:12.633 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:12.633 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-06T03:26:12.633 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:12.633 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:12.633 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:12.634 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:12.687 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-04-06T03:26:12.729 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-04-06T03:26:12.788 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 312 kB/s | 18 kB 00:00 2024-04-06T03:26:12.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-06T03:26:12.946 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 222 kB/s | 35 kB 00:00 2024-04-06T03:26:13.163 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.3 MB/s | 3.0 MB 00:00 2024-04-06T03:26:13.272 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-04-06T03:26:13.483 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:19 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:13.779 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:13.779 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:13.779 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:13.779 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.779 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:13.779 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.780 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:13.781 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:13.782 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.783 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:13.784 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:13.785 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.786 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.787 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.788 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.789 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:13.847 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.9 MB/s | 5.1 MB 00:00 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 7.4 M 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-06T03:26:13.857 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-06T03:26:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:13.859 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:13.859 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-04-06T03:26:13.859 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-04-06T03:26:13.859 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:13.859 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 38 M 2024-04-06T03:26:13.859 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 209 M 2024-04-06T03:26:13.859 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:13.964 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 4.7 MB/s | 4.7 MB 00:01 2024-04-06T03:26:14.064 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.1 MB/s | 250 kB 00:00 2024-04-06T03:26:14.326 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 957 kB/s | 195 kB 00:00 2024-04-06T03:26:14.510 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 179 kB/s | 33 kB 00:00 2024-04-06T03:26:14.727 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-04-06T03:26:14.848 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-04-06T03:26:14.877 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 121 kB/s | 18 kB 00:00 2024-04-06T03:26:14.977 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 352 kB/s | 35 kB 00:00 2024-04-06T03:26:15.481 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 2.4 MB/s | 7.4 MB 00:03 2024-04-06T03:26:15.482 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:15.482 INFO:teuthology.orchestra.run.smithi047.stdout:Total 11 MB/s | 38 MB 00:03 2024-04-06T03:26:15.653 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-04-06T03:26:15.761 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-04-06T03:26:15.846 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:15.874 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:15.875 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:16.195 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 3.9 MB/s | 4.7 MB 00:01 2024-04-06T03:26:16.262 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-04-06T03:26:16.325 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:16.325 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:16.445 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-04-06T03:26:16.945 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-2 2.6 MB/s | 7.4 MB 00:02 2024-04-06T03:26:17.108 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:17.185 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-06T03:26:17.230 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-06T03:26:17.333 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-06T03:26:17.372 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-06T03:26:17.437 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-04-06T03:26:17.438 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:17.438 INFO:teuthology.orchestra.run.smithi102.stdout:Total 11 MB/s | 38 MB 00:03 2024-04-06T03:26:17.556 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-06T03:26:17.588 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-06T03:26:17.672 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-06T03:26:17.787 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:17.814 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:17.814 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:18.231 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:18.232 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:18.381 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-06T03:26:18.504 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-06T03:26:18.998 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:19.061 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-06T03:26:19.102 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-06T03:26:19.192 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-06T03:26:19.237 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-06T03:26:19.412 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-06T03:26:19.444 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-06T03:26:19.520 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-06T03:26:19.800 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-06T03:26:20.179 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-06T03:26:20.298 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-06T03:26:20.873 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-06T03:26:20.904 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2027.g9f192 12/12 2024-04-06T03:26:21.544 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-06T03:26:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-06T03:26:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2027.g9f192 12/12 2024-04-06T03:26:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2027.g9f192 12/12 2024-04-06T03:26:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2027.g9f192 1/12 2024-04-06T03:26:23.297 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-06T03:26:23.298 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-06T03:26:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-06T03:26:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:23.796 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:23.797 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:24.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-rook 2024-04-06T03:26:24.840 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:29 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:25.141 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:25.142 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:25.143 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:25.144 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:25.145 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:25.146 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:25.147 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.148 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.149 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.150 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:25.151 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.151 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.151 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.151 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:25.157 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2027.g9f192 12/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2027.g9f192 1/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-06T03:26:25.158 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-06T03:26:25.216 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:25.217 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:26:25.217 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:25.217 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:25.217 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 49 k 2024-04-06T03:26:25.217 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-06T03:26:25.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-06T03:26:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:25.219 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:25.219 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:25.219 INFO:teuthology.orchestra.run.smithi047.stdout:Install 13 Packages 2024-04-06T03:26:25.219 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:25.219 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.2 M 2024-04-06T03:26:25.220 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 26 M 2024-04-06T03:26:25.220 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:25.555 INFO:teuthology.orchestra.run.smithi047.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 225 kB/s | 26 kB 00:00 2024-04-06T03:26:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 138 kB/s | 19 kB 00:00 2024-04-06T03:26:25.583 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-06T03:26:25.583 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:25.584 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:25.672 INFO:teuthology.orchestra.run.smithi047.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-04-06T03:26:25.697 INFO:teuthology.orchestra.run.smithi047.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-06T03:26:25.739 INFO:teuthology.orchestra.run.smithi047.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 279 kB 00:00 2024-04-06T03:26:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:(6/13): ceph-mgr-rook-19.0.0-2027.g9f192350.el9 152 kB/s | 49 kB 00:00 2024-04-06T03:26:25.789 INFO:teuthology.orchestra.run.smithi047.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 581 kB/s | 54 kB 00:00 2024-04-06T03:26:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 128 kB/s | 15 kB 00:00 2024-04-06T03:26:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 192 kB/s | 32 kB 00:00 2024-04-06T03:26:25.976 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-rook 2024-04-06T03:26:26.015 INFO:teuthology.orchestra.run.smithi047.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 899 kB/s | 203 kB 00:00 2024-04-06T03:26:26.041 INFO:teuthology.orchestra.run.smithi047.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 442 kB/s | 59 kB 00:00 2024-04-06T03:26:26.099 INFO:teuthology.orchestra.run.smithi047.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2024-04-06T03:26:26.149 INFO:teuthology.orchestra.run.smithi047.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.8 MB/s | 1.0 MB 00:00 2024-04-06T03:26:26.150 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:26.150 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-04-06T03:26:26.219 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:26.235 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:26.235 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:26.338 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:26.338 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:26.576 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:32 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:26.863 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:26.863 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.869 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.870 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.871 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.872 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:26.935 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 49 k 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-06T03:26:26.937 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout:Install 13 Packages 2024-04-06T03:26:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:26.939 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 2.2 M 2024-04-06T03:26:26.939 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 26 M 2024-04-06T03:26:26.939 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:27.047 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-06T03:26:27.158 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-06T03:26:27.195 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-06T03:26:27.238 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-06T03:26:27.336 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-06T03:26:27.445 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-06T03:26:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-06T03:26:27.669 INFO:teuthology.orchestra.run.smithi102.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 94 kB/s | 26 kB 00:00 2024-04-06T03:26:27.694 INFO:teuthology.orchestra.run.smithi102.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 64 kB/s | 19 kB 00:00 2024-04-06T03:26:27.761 INFO:teuthology.orchestra.run.smithi102.stdout:(3/13): ceph-mgr-rook-19.0.0-2027.g9f192350.el9 135 kB/s | 49 kB 00:00 2024-04-06T03:26:27.828 INFO:teuthology.orchestra.run.smithi102.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-04-06T03:26:27.853 INFO:teuthology.orchestra.run.smithi102.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-04-06T03:26:27.945 INFO:teuthology.orchestra.run.smithi102.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 458 kB/s | 54 kB 00:00 2024-04-06T03:26:28.120 INFO:teuthology.orchestra.run.smithi102.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 776 kB/s | 279 kB 00:00 2024-04-06T03:26:28.204 INFO:teuthology.orchestra.run.smithi102.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 98 kB/s | 32 kB 00:00 2024-04-06T03:26:28.268 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-06T03:26:28.271 INFO:teuthology.orchestra.run.smithi102.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 46 kB/s | 15 kB 00:00 2024-04-06T03:26:28.335 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-06T03:26:28.370 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-06T03:26:28.427 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-06T03:26:28.456 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.0.0-2027.g9f192350.el9.noarch 13/13 2024-04-06T03:26:28.629 INFO:teuthology.orchestra.run.smithi102.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 165 kB/s | 59 kB 00:00 2024-04-06T03:26:29.021 INFO:teuthology.orchestra.run.smithi102.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 229 kB/s | 90 kB 00:00 2024-04-06T03:26:29.122 INFO:teuthology.orchestra.run.smithi102.stdout:(12/13): python3-google-auth-2.28.2-1.el9.noarc 202 kB/s | 203 kB 00:01 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2027.g9f192350.el9.noarch 13/13 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2027.g9f192350.el9.noarch 1/13 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-06T03:26:29.282 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-06T03:26:29.283 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-06T03:26:29.678 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-06T03:26:29.679 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-06T03:26:29.680 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-06T03:26:29.680 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-06T03:26:29.680 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-06T03:26:29.680 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:29.680 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:29.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-cephadm 2024-04-06T03:26:30.532 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:35 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:30.835 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:30.835 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:30.835 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.836 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:30.837 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.840 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.841 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:30.843 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:30.909 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:30.909 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 139 k 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-06T03:26:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-06T03:26:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:30.911 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:30.911 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:30.911 INFO:teuthology.orchestra.run.smithi047.stdout:Install 6 Packages 2024-04-06T03:26:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:30.911 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 7.0 M 2024-04-06T03:26:30.911 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 33 M 2024-04-06T03:26:30.911 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:31.089 INFO:teuthology.orchestra.run.smithi102.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 362 kB/s | 1.0 MB 00:02 2024-04-06T03:26:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:Total 542 kB/s | 2.2 MB 00:04 2024-04-06T03:26:31.157 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:31.172 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:31.172 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:31.269 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:31.270 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:31.345 INFO:teuthology.orchestra.run.smithi047.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 2.3 MB/s | 248 kB 00:00 2024-04-06T03:26:31.454 INFO:teuthology.orchestra.run.smithi047.stdout:(2/6): ceph-mgr-cephadm-19.0.0-2027.g9f192350.e 650 kB/s | 139 kB 00:00 2024-04-06T03:26:31.562 INFO:teuthology.orchestra.run.smithi047.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-04-06T03:26:31.621 INFO:teuthology.orchestra.run.smithi047.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 346 kB/s | 58 kB 00:00 2024-04-06T03:26:31.688 INFO:teuthology.orchestra.run.smithi047.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.6 MB/s | 548 kB 00:00 2024-04-06T03:26:31.763 INFO:teuthology.orchestra.run.smithi047.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 254 kB/s | 51 kB 00:00 2024-04-06T03:26:31.764 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:31.764 INFO:teuthology.orchestra.run.smithi047.stdout:Total 8.2 MB/s | 7.0 MB 00:00 2024-04-06T03:26:31.786 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:31.839 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:31.851 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:31.851 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:31.957 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:31.958 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-06T03:26:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-06T03:26:32.103 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-06T03:26:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-06T03:26:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-06T03:26:32.272 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:32.277 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-06T03:26:32.385 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-06T03:26:32.442 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-06T03:26:32.453 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-06T03:26:32.499 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-06T03:26:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-06T03:26:33.137 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-06T03:26:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-06T03:26:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-06T03:26:33.206 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-06T03:26:33.235 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2027.g9f192350.el9.noarch 6/6 2024-04-06T03:26:33.240 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-06T03:26:33.288 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-06T03:26:33.310 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.0.0-2027.g9f192350.el9.noarch 13/13 2024-04-06T03:26:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2027.g9f192350.el9.noarch 6/6 2024-04-06T03:26:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/6 2024-04-06T03:26:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-06T03:26:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-06T03:26:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-06T03:26:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-06T03:26:34.138 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2027.g9f192350.el9.noarch 13/13 2024-04-06T03:26:34.138 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2027.g9f192350.el9.noarch 1/13 2024-04-06T03:26:34.138 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-06T03:26:34.138 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-06T03:26:34.138 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-06T03:26:34.139 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-06T03:26:34.139 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-06T03:26:34.139 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-06T03:26:34.139 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-06T03:26:34.139 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-06T03:26:34.139 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-06T03:26:34.139 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-06T03:26:34.139 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:34.368 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:34.517 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-06T03:26:34.518 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-06T03:26:34.519 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-06T03:26:34.519 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-06T03:26:34.519 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-06T03:26:34.519 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:34.519 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:34.589 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-fuse 2024-04-06T03:26:34.799 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-cephadm 2024-04-06T03:26:35.192 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:40 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:35.395 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:41 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:35.492 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:35.492 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:35.492 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:35.492 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.492 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:35.493 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.494 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:35.495 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:35.496 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:35.497 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.498 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:35.499 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.565 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:35.565 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.0.0-2027.g9f192350.el9 ceph 889 k 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout:Install 2 Packages 2024-04-06T03:26:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:35.567 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 970 k 2024-04-06T03:26:35.567 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 2.8 M 2024-04-06T03:26:35.567 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:35.682 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:35.682 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:35.682 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:35.682 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.683 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:35.684 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:35.685 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.686 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:35.687 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.688 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.689 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.690 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.691 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:35.752 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:35.752 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:35.752 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 139 k 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout:Install 6 Packages 2024-04-06T03:26:35.753 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:35.754 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 7.0 M 2024-04-06T03:26:35.754 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 33 M 2024-04-06T03:26:35.754 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:36.048 INFO:teuthology.orchestra.run.smithi047.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 630 kB/s | 80 kB 00:00 2024-04-06T03:26:36.499 INFO:teuthology.orchestra.run.smithi102.stdout:(1/6): ceph-mgr-cephadm-19.0.0-2027.g9f192350.e 537 kB/s | 139 kB 00:00 2024-04-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi047.stdout:(2/2): ceph-fuse-19.0.0-2027.g9f192350.el9.x86_ 1.4 MB/s | 889 kB 00:00 2024-04-06T03:26:36.548 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:36.549 INFO:teuthology.orchestra.run.smithi047.stdout:Total 987 kB/s | 970 kB 00:00 2024-04-06T03:26:36.562 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:36.585 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:36.586 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:36.668 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:36.669 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:37.004 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-06T03:26:37.085 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 2/2 2024-04-06T03:26:37.099 INFO:teuthology.orchestra.run.smithi102.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 913 kB/s | 548 kB 00:00 2024-04-06T03:26:37.124 INFO:teuthology.orchestra.run.smithi102.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 280 kB/s | 248 kB 00:00 2024-04-06T03:26:37.166 INFO:teuthology.orchestra.run.smithi102.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 863 kB/s | 58 kB 00:00 2024-04-06T03:26:37.442 INFO:teuthology.orchestra.run.smithi102.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 161 kB/s | 51 kB 00:00 2024-04-06T03:26:37.804 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 2/2 2024-04-06T03:26:37.804 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 1/2 2024-04-06T03:26:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-06T03:26:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:38.123 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-06T03:26:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:38.123 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:38.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-volume 2024-04-06T03:26:39.048 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:44 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:39.351 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:39.351 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:39.351 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:39.351 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:39.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:39.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:39.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.360 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:39.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:39.428 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 264 k 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:39.429 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:39.430 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:39.430 INFO:teuthology.orchestra.run.smithi047.stdout:Install 2 Packages 2024-04-06T03:26:39.430 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:39.430 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 341 k 2024-04-06T03:26:39.430 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 1.5 M 2024-04-06T03:26:39.430 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:39.745 INFO:teuthology.orchestra.run.smithi047.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 398 kB/s | 77 kB 00:00 2024-04-06T03:26:40.220 INFO:teuthology.orchestra.run.smithi047.stdout:(2/2): ceph-volume-19.0.0-2027.g9f192350.el9.no 394 kB/s | 264 kB 00:00 2024-04-06T03:26:40.221 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:40.221 INFO:teuthology.orchestra.run.smithi047.stdout:Total 431 kB/s | 341 kB 00:00 2024-04-06T03:26:40.234 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:40.246 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:40.246 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:40.294 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:40.295 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:40.453 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:40.643 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-06T03:26:40.673 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.0.0-2027.g9f192350.el9.noarch 2/2 2024-04-06T03:26:40.688 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.0.0-2027.g9f192350.el9.noarch 2/2 2024-04-06T03:26:40.688 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:26:40.688 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-06T03:26:40.688 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:41.425 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.0.0-2027.g9f192350.el9.noarch 1/2 2024-04-06T03:26:41.775 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-06T03:26:41.775 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:41.775 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:41.775 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:41.775 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-06T03:26:41.775 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:41.776 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:41.850 INFO:teuthology.orchestra.run.smithi102.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 1.1 MB/s | 6.0 MB 00:05 2024-04-06T03:26:41.852 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:41.852 INFO:teuthology.orchestra.run.smithi102.stdout:Total 1.1 MB/s | 7.0 MB 00:06 2024-04-06T03:26:41.924 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:41.936 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:41.936 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:42.038 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:42.039 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:42.118 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados-devel 2024-04-06T03:26:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:42.539 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-06T03:26:42.584 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-06T03:26:42.729 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:47 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:43.038 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:43.038 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:43.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:43.042 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.043 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:43.044 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.045 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.046 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.047 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:43.047 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.047 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.047 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.047 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-06T03:26:43.112 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:43.112 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:43.112 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-04-06T03:26:43.112 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:43.112 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.0.0-2027.g9f192350.el9 ceph 127 k 2024-04-06T03:26:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:43.113 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:43.113 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:43.113 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-04-06T03:26:43.113 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:43.113 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 127 k 2024-04-06T03:26:43.113 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 456 k 2024-04-06T03:26:43.114 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:43.171 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-06T03:26:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-06T03:26:43.255 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2027.g9f192350.el9.noarch 6/6 2024-04-06T03:26:43.685 INFO:teuthology.orchestra.run.smithi047.stdout:librados-devel-19.0.0-2027.g9f192350.el9.x86_64 222 kB/s | 127 kB 00:00 2024-04-06T03:26:43.686 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:43.686 INFO:teuthology.orchestra.run.smithi047.stdout:Total 221 kB/s | 127 kB 00:00 2024-04-06T03:26:43.686 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:43.692 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:43.692 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:43.756 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:43.756 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:43.907 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:44.003 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:44.069 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2027.g9f192350.el9.noarch 6/6 2024-04-06T03:26:44.069 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2027.g9f192350.el9.noarch 1/6 2024-04-06T03:26:44.069 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-06T03:26:44.069 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-06T03:26:44.069 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-06T03:26:44.069 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-06T03:26:44.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-06T03:26:44.386 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:44.386 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:44.387 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:44.387 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-06T03:26:44.387 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-06T03:26:44.387 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-06T03:26:44.387 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-06T03:26:44.387 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-06T03:26:44.387 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:44.387 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:44.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-fuse 2024-04-06T03:26:44.754 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:44.755 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:44.755 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:44.755 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:26:44.755 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:44.755 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:44.987 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs2 2024-04-06T03:26:45.264 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:51 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:45.557 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:45.557 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:45.557 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.558 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.560 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.562 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:45.562 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.562 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:45.562 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.562 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:45.562 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.562 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:45.562 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.563 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.564 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.566 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.567 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.568 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.568 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.602 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:50 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:45.629 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:45.629 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.0.0-2027.g9f192350.el9 ceph 889 k 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout:Install 2 Packages 2024-04-06T03:26:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:45.631 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 970 k 2024-04-06T03:26:45.631 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 2.8 M 2024-04-06T03:26:45.631 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:45.907 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:45.907 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:45.907 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.907 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:45.907 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.907 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:45.908 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.909 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:45.910 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:45.911 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:45.912 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:45.913 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:45.914 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.915 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.916 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.917 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.918 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.918 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:45.918 INFO:teuthology.orchestra.run.smithi047.stdout:Package libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:45.968 INFO:teuthology.orchestra.run.smithi102.stdout:(1/2): ceph-fuse-19.0.0-2027.g9f192350.el9.x86_ 3.1 MB/s | 889 kB 00:00 2024-04-06T03:26:45.981 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:45.982 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:26:45.982 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:45.985 INFO:teuthology.orchestra.run.smithi102.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 270 kB/s | 80 kB 00:00 2024-04-06T03:26:45.986 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:45.986 INFO:teuthology.orchestra.run.smithi102.stdout:Total 2.7 MB/s | 970 kB 00:00 2024-04-06T03:26:45.997 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:46.020 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:46.020 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:46.055 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs-devel 2024-04-06T03:26:46.099 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:46.099 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:46.284 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-06T03:26:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 2/2 2024-04-06T03:26:46.663 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:51 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:46.966 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:46.966 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:46.966 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:46.966 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.967 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.968 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:46.969 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.970 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:46.971 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.972 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.973 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.974 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.975 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.975 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:46.975 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.975 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.975 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:46.975 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:47.039 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.0.0-2027.g9f192350.el9 ceph 32 k 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-04-06T03:26:47.040 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:47.041 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 32 k 2024-04-06T03:26:47.041 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 142 k 2024-04-06T03:26:47.041 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:47.195 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 2/2 2024-04-06T03:26:47.195 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 1/2 2024-04-06T03:26:47.197 INFO:teuthology.orchestra.run.smithi047.stdout:libcephfs-devel-19.0.0-2027.g9f192350.el9.x86_6 204 kB/s | 32 kB 00:00 2024-04-06T03:26:47.197 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:47.197 INFO:teuthology.orchestra.run.smithi047.stdout:Total 201 kB/s | 32 kB 00:00 2024-04-06T03:26:47.198 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:47.201 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:47.238 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:47.238 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:47.341 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-06T03:26:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:47.542 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-06T03:26:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:47.542 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:47.822 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:47.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-volume 2024-04-06T03:26:48.114 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:48.115 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:48.115 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:48.115 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:26:48.115 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:48.115 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:48.279 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados2 2024-04-06T03:26:48.433 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:54 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:48.722 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:48.724 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:48.725 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.726 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:48.727 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:48.728 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.729 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.730 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.731 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.732 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:48.792 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:48.793 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:48.793 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-06T03:26:48.793 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:48.793 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:48.793 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.0.0-2027.g9f192350.el9 ceph-noarch 264 k 2024-04-06T03:26:48.793 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-06T03:26:48.794 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-06T03:26:48.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:48.794 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:48.794 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:48.794 INFO:teuthology.orchestra.run.smithi102.stdout:Install 2 Packages 2024-04-06T03:26:48.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:48.794 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 341 k 2024-04-06T03:26:48.795 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 1.5 M 2024-04-06T03:26:48.795 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:48.883 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:53 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:49.107 INFO:teuthology.orchestra.run.smithi102.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 446 kB/s | 77 kB 00:00 2024-04-06T03:26:49.184 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:49.184 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:49.184 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:49.184 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:49.185 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.186 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.187 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.188 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.189 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.190 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.191 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.192 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.193 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:49.193 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.193 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.193 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.193 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:49.193 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:49.258 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:49.259 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:26:49.259 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:49.320 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librbd1 2024-04-06T03:26:49.357 INFO:teuthology.orchestra.run.smithi102.stdout:(2/2): ceph-volume-19.0.0-2027.g9f192350.el9.no 623 kB/s | 264 kB 00:00 2024-04-06T03:26:49.358 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:49.359 INFO:teuthology.orchestra.run.smithi102.stdout:Total 604 kB/s | 341 kB 00:00 2024-04-06T03:26:49.370 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:49.380 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:49.380 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:49.420 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:49.420 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:49.580 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:49.764 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-06T03:26:49.802 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.0.0-2027.g9f192350.el9.noarch 2/2 2024-04-06T03:26:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.0.0-2027.g9f192350.el9.noarch 2/2 2024-04-06T03:26:49.818 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:26:49.818 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-06T03:26:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:49.924 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:54 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:50.224 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:50.225 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.226 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:50.227 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.228 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:50.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:50.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:50.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.229 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:50.229 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:50.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:50.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:50.230 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.230 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:50.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.231 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:50.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.231 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:50.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.231 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:50.231 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:50.232 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.233 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:50.234 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.235 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.236 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.237 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:50.237 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:50.298 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:50.299 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:26:50.299 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:50.356 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rados 2024-04-06T03:26:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.0.0-2027.g9f192350.el9.noarch 1/2 2024-04-06T03:26:50.894 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-06T03:26:50.894 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:50.894 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:50.894 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.0.0-2027.g9f192350.el9.noarch 2024-04-06T03:26:50.894 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-06T03:26:50.894 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:50.895 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:50.971 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:55 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:51.247 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados-devel 2024-04-06T03:26:51.279 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:51.279 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:51.280 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:51.280 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.280 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:51.280 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.280 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:51.280 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.281 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:51.281 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.281 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:51.281 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.281 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:51.281 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.282 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:51.283 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.284 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:51.285 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.286 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.287 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:51.288 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.289 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:51.290 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.290 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.290 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.290 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:51.290 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rados-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:51.355 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:51.356 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:26:51.357 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:51.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rgw 2024-04-06T03:26:51.856 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:57 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:52.040 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:57 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:52.146 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:52.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:52.146 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.146 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:52.146 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:52.147 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:52.148 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:52.149 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.150 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.151 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.152 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:52.153 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.154 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.155 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:52.155 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.155 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.155 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.155 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.215 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:52.217 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-04-06T03:26:52.217 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:52.217 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.0.0-2027.g9f192350.el9 ceph 127 k 2024-04-06T03:26:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:52.218 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:52.218 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:52.218 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-04-06T03:26:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:52.218 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 127 k 2024-04-06T03:26:52.218 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 456 k 2024-04-06T03:26:52.218 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:52.348 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:52.349 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:52.349 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:52.349 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.349 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:52.349 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.349 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:52.350 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.350 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:52.350 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.350 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:52.350 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.350 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.351 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:52.352 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:52.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:52.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.353 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:52.353 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:52.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:52.354 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.354 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:52.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:52.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:52.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.355 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:52.355 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:52.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:52.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.356 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:52.356 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.357 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:52.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.357 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:52.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.357 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:52.357 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.358 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:52.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.358 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:52.358 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.358 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:52.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.359 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:52.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.359 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:52.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.359 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:52.359 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.360 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:52.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.360 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:52.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.360 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:52.360 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.361 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:52.361 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.361 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.361 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.361 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:52.361 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.362 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.362 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.362 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.362 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:52.362 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.363 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.363 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.363 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.363 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.363 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.363 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:52.364 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.364 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.364 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.364 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.364 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:52.364 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.365 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.365 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.365 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.365 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:52.365 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.365 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.366 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.366 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.366 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:52.366 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.367 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.367 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.367 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.367 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:52.367 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.367 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.368 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.368 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.368 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:52.368 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.368 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.368 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.369 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:52.369 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rgw-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:52.423 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:52.424 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:26:52.424 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:52.493 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-cephfs 2024-04-06T03:26:52.606 INFO:teuthology.orchestra.run.smithi102.stdout:librados-devel-19.0.0-2027.g9f192350.el9.x86_64 325 kB/s | 127 kB 00:00 2024-04-06T03:26:52.607 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:52.607 INFO:teuthology.orchestra.run.smithi102.stdout:Total 324 kB/s | 127 kB 00:00 2024-04-06T03:26:52.607 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:52.613 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:52.613 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:52.672 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:52.673 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:52.819 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:52.913 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:53.103 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:58 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:53.356 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:53.405 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:53.405 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:53.405 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.405 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.406 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.407 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:53.408 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:53.409 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.410 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:53.411 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.412 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.413 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.414 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.415 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-cephfs-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:53.479 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:53.480 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:26:53.480 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:53.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rbd 2024-04-06T03:26:53.677 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:53.677 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:53.677 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:53.677 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:26:53.677 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:53.677 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:53.915 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs2 2024-04-06T03:26:54.155 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:59 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:54.462 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.463 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:54.464 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:54.465 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:54.466 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:54.467 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.468 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.469 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:54.470 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.471 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.472 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rbd-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:54.534 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:00 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:54.536 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:54.538 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-04-06T03:26:54.538 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:54.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-fuse 2024-04-06T03:26:54.824 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:54.824 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:54.824 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.825 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:54.826 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:54.827 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:54.828 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:54.834 INFO:teuthology.orchestra.run.smithi102.stdout:Package libcephfs2-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:54.897 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:54.898 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:26:54.898 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:54.975 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs-devel 2024-04-06T03:26:55.200 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:00 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:55.500 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:55.500 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:55.500 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:55.501 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.502 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.503 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.504 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:55.505 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.506 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.507 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.508 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.509 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.566 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:01 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:55.572 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.0.0-2027.g9f192350.el9 ceph 85 k 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-04-06T03:26:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:55.574 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 85 k 2024-04-06T03:26:55.574 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 231 k 2024-04-06T03:26:55.574 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.857 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:55.858 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.859 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:55.860 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.861 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:55.862 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.862 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:55.862 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.862 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:55.862 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.862 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.863 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.864 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.865 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.866 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:55.892 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-fuse-19.0.0-2027.g9f192350.el9.x86_64.rpm 268 kB/s | 85 kB 00:00 2024-04-06T03:26:55.892 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:55.893 INFO:teuthology.orchestra.run.smithi047.stdout:Total 267 kB/s | 85 kB 00:00 2024-04-06T03:26:55.893 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:55.900 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:55.900 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:55.926 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:55.926 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.0.0-2027.g9f192350.el9 ceph 32 k 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 32 k 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 142 k 2024-04-06T03:26:55.927 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:26:55.962 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:55.962 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:56.185 INFO:teuthology.orchestra.run.smithi102.stdout:libcephfs-devel-19.0.0-2027.g9f192350.el9.x86_6 123 kB/s | 32 kB 00:00 2024-04-06T03:26:56.185 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:56.185 INFO:teuthology.orchestra.run.smithi102.stdout:Total 123 kB/s | 32 kB 00:00 2024-04-06T03:26:56.186 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:26:56.189 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:26:56.189 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:26:56.216 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:26:56.217 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:26:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:56.298 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:26:56.407 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:56.662 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:56.759 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:56.970 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:56.970 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:56.970 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:26:56.971 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:26:56.971 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:56.971 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:26:57.043 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:57.043 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:57.043 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:26:57.043 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:26:57.044 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:26:57.044 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:57.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-mirror 2024-04-06T03:26:57.221 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados2 2024-04-06T03:26:57.786 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:02 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:26:57.811 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:03 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.089 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:26:58.090 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.091 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:26:58.092 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.093 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:26:58.094 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:58.095 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:58.096 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.097 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.098 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:58.099 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.099 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.099 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.099 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:58.099 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:58.100 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.101 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:58.103 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:58.105 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.106 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.107 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.108 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.109 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:58.110 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:58.161 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:26:58.162 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:58.162 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-04-06T03:26:58.162 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:58.162 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.0.0-2027.g9f192350.el9 ceph 3.1 M 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 3.1 M 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 13 M 2024-04-06T03:26:58.163 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:26:58.167 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:58.168 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:26:58.168 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:58.242 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librbd1 2024-04-06T03:26:58.836 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:04 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:26:59.125 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:26:59.125 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:26:59.125 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:26:59.125 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:26:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:26:59.127 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.128 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:26:59.129 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.130 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:26:59.131 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.132 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:26:59.133 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.134 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.135 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:26:59.136 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:26:59.194 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:26:59.195 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:26:59.195 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:26:59.212 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-mirror-19.0.0-2027.g9f192350.el9.x86_64.rpm 2.9 MB/s | 3.1 MB 00:01 2024-04-06T03:26:59.213 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:26:59.213 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.9 MB/s | 3.1 MB 00:01 2024-04-06T03:26:59.213 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:26:59.225 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:26:59.225 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:26:59.277 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rados 2024-04-06T03:26:59.308 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:26:59.309 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:26:59.753 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:26:59.813 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:59.837 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:26:59.837 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:26:59.837 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-06T03:26:59.837 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-06T03:26:59.838 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-06T03:26:59.838 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:26:59.876 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:05 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:27:00.164 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.165 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:27:00.166 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.167 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:27:00.168 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:27:00.169 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.170 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.171 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:27:00.172 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:27:00.173 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rados-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:27:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:27:00.234 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:27:00.234 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:27:00.315 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rgw 2024-04-06T03:27:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:27:00.915 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:27:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:27:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:27:00.915 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:27:00.916 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:06 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:27:01.181 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-nbd 2024-04-06T03:27:01.204 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:27:01.204 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.205 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:27:01.206 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.207 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.208 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.209 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.210 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.211 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.212 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.213 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:27:01.214 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rgw-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:27:01.274 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:27:01.275 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:27:01.275 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:27:01.361 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-cephfs 2024-04-06T03:27:01.798 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:06 ago on Sat 06 Apr 2024 03:24:55 AM UTC. 2024-04-06T03:27:01.970 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:07 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.100 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-06T03:27:02.101 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-06T03:27:02.102 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-06T03:27:02.103 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.104 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-06T03:27:02.105 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.107 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.108 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.109 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:27:02.109 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.109 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.109 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.109 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.171 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-06T03:27:02.172 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:27:02.172 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-04-06T03:27:02.172 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:27:02.172 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-06T03:27:02.172 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.0.0-2027.g9f192350.el9 ceph 170 k 2024-04-06T03:27:02.172 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:27:02.173 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-06T03:27:02.173 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-06T03:27:02.173 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-04-06T03:27:02.173 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:27:02.173 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 170 k 2024-04-06T03:27:02.173 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 494 k 2024-04-06T03:27:02.173 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-06T03:27:02.256 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:27:02.256 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.257 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:27:02.258 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.259 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.260 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.261 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.262 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.263 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.264 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.265 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:27:02.266 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-cephfs-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:27:02.329 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:27:02.330 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:27:02.331 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:27:02.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rbd 2024-04-06T03:27:02.515 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-nbd-19.0.0-2027.g9f192350.el9.x86_64.rpm 498 kB/s | 170 kB 00:00 2024-04-06T03:27:02.516 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:27:02.516 INFO:teuthology.orchestra.run.smithi047.stdout:Total 496 kB/s | 170 kB 00:00 2024-04-06T03:27:02.516 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-06T03:27:02.525 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-06T03:27:02.525 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-06T03:27:02.587 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-06T03:27:02.587 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-06T03:27:02.746 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-06T03:27:02.843 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:03.008 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:09 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:27:03.258 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:03.296 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:27:03.296 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:27:03.296 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:27:03.296 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.297 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.298 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:27:03.299 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.300 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.301 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:27:03.302 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:27:03.303 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:27:03.304 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.305 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.306 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.307 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.308 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:27:03.308 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rbd-2:19.0.0-2027.g9f192350.el9.x86_64 is already installed. 2024-04-06T03:27:03.367 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:27:03.368 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-06T03:27:03.368 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:27:03.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-fuse 2024-04-06T03:27:03.522 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:03.522 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:27:03.522 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-06T03:27:03.522 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:27:03.522 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:27:03.522 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-06T03:27:03.745 DEBUG:teuthology.parallel:result is None 2024-04-06T03:27:04.027 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:10 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:27:04.313 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:27:04.313 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:27:04.314 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:27:04.315 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:27:04.316 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.317 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.318 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.319 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.320 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.321 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.322 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:27:04.383 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:27:04.383 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:04.383 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.0.0-2027.g9f192350.el9 ceph 85 k 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 85 k 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 231 k 2024-04-06T03:27:04.384 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:27:04.596 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-fuse-19.0.0-2027.g9f192350.el9.x86_64.rpm 402 kB/s | 85 kB 00:00 2024-04-06T03:27:04.597 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:27:04.597 INFO:teuthology.orchestra.run.smithi102.stdout:Total 399 kB/s | 85 kB 00:00 2024-04-06T03:27:04.597 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:27:04.604 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:27:04.604 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:27:04.664 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:27:04.664 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:27:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:27:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:05.359 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:05.675 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:05.675 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:05.675 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:27:05.675 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:27:05.675 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:05.676 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:27:05.929 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-mirror 2024-04-06T03:27:06.535 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:12 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:27:06.829 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:27:06.829 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:27:06.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:27:06.829 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:27:06.829 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.829 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:27:06.830 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:27:06.831 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:27:06.832 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.833 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:27:06.834 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:27:06.835 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.836 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:27:06.837 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.838 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.838 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.838 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.838 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:27:06.838 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.838 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.838 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.838 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:27:06.897 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:27:06.898 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:06.898 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-04-06T03:27:06.898 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:06.898 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:27:06.898 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.0.0-2027.g9f192350.el9 ceph 3.1 M 2024-04-06T03:27:06.898 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:06.898 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:27:06.899 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:06.899 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-04-06T03:27:06.899 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:06.899 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 3.1 M 2024-04-06T03:27:06.899 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 13 M 2024-04-06T03:27:06.899 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:27:07.375 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-mirror-19.0.0-2027.g9f192350.el9.x86_64.rpm 6.5 MB/s | 3.1 MB 00:00 2024-04-06T03:27:07.376 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:27:07.376 INFO:teuthology.orchestra.run.smithi102.stdout:Total 6.5 MB/s | 3.1 MB 00:00 2024-04-06T03:27:07.376 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:27:07.385 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:27:07.385 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:27:07.462 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:27:07.463 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:27:07.897 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:27:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:07.985 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-06T03:27:07.985 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-06T03:27:07.985 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-06T03:27:07.985 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-06T03:27:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:09.119 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:09.119 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:09.119 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:27:09.119 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:27:09.119 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:09.119 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:27:09.373 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-nbd 2024-04-06T03:27:09.985 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:02:15 ago on Sat 06 Apr 2024 03:24:54 AM UTC. 2024-04-06T03:27:10.274 INFO:teuthology.orchestra.run.smithi102.stderr:Modular dependency problems: 2024-04-06T03:27:10.274 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T03:27:10.274 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 1: conflicting requests 2024-04-06T03:27:10.275 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.275 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 2: conflicting requests 2024-04-06T03:27:10.275 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.275 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 3: conflicting requests 2024-04-06T03:27:10.275 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.275 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 4: conflicting requests 2024-04-06T03:27:10.275 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.275 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 5: conflicting requests 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 6: conflicting requests 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 7: conflicting requests 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 8: conflicting requests 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 9: conflicting requests 2024-04-06T03:27:10.276 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 10: conflicting requests 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 11: conflicting requests 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 12: conflicting requests 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 13: conflicting requests 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 14: conflicting requests 2024-04-06T03:27:10.277 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 15: conflicting requests 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 16: conflicting requests 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 17: conflicting requests 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 18: conflicting requests 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.278 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 19: conflicting requests 2024-04-06T03:27:10.279 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.279 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 20: conflicting requests 2024-04-06T03:27:10.279 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.279 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 21: conflicting requests 2024-04-06T03:27:10.279 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.279 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 22: conflicting requests 2024-04-06T03:27:10.279 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.279 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 23: conflicting requests 2024-04-06T03:27:10.280 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.280 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 24: conflicting requests 2024-04-06T03:27:10.281 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.281 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 25: conflicting requests 2024-04-06T03:27:10.281 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.281 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 26: conflicting requests 2024-04-06T03:27:10.281 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.281 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 27: conflicting requests 2024-04-06T03:27:10.282 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.282 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 28: conflicting requests 2024-04-06T03:27:10.282 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.282 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 29: conflicting requests 2024-04-06T03:27:10.282 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.282 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 30: conflicting requests 2024-04-06T03:27:10.282 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.283 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 31: conflicting requests 2024-04-06T03:27:10.283 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.283 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 32: conflicting requests 2024-04-06T03:27:10.283 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.283 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 33: conflicting requests 2024-04-06T03:27:10.283 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.283 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 34: conflicting requests 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 35: conflicting requests 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 36: conflicting requests 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 37: conflicting requests 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.284 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 38: cannot install the best candidate for the job 2024-04-06T03:27:10.285 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.285 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.285 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.285 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.285 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 39: conflicting requests 2024-04-06T03:27:10.285 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.285 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.285 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.286 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.286 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.286 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.286 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 40: cannot install the best candidate for the job 2024-04-06T03:27:10.286 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.286 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.286 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.286 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.287 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 41: cannot install the best candidate for the job 2024-04-06T03:27:10.287 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.287 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.287 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.287 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.287 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 42: cannot install the best candidate for the job 2024-04-06T03:27:10.287 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.287 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 43: cannot install the best candidate for the job 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 44: cannot install the best candidate for the job 2024-04-06T03:27:10.288 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.289 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.289 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.289 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.289 INFO:teuthology.orchestra.run.smithi102.stderr: Problem 45: cannot install the best candidate for the job 2024-04-06T03:27:10.289 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.289 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.289 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.290 INFO:teuthology.orchestra.run.smithi102.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-06T03:27:10.342 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-06T03:27:10.342 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-04-06T03:27:10.342 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:10.342 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-06T03:27:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.0.0-2027.g9f192350.el9 ceph 170 k 2024-04-06T03:27:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:10.342 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-06T03:27:10.343 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-06T03:27:10.343 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-04-06T03:27:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:10.343 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 170 k 2024-04-06T03:27:10.343 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 494 k 2024-04-06T03:27:10.343 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-06T03:27:10.912 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-nbd-19.0.0-2027.g9f192350.el9.x86_64.rpm 300 kB/s | 170 kB 00:00 2024-04-06T03:27:10.912 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:27:10.912 INFO:teuthology.orchestra.run.smithi102.stdout:Total 299 kB/s | 170 kB 00:00 2024-04-06T03:27:10.913 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-06T03:27:10.920 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-06T03:27:10.920 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-06T03:27:10.981 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-06T03:27:10.981 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-06T03:27:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-06T03:27:11.236 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:11.665 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:11.984 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.0.0-2027.g9f192350.el9.x86_64 1/1 2024-04-06T03:27:11.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:11.984 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-06T03:27:11.984 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.0.0-2027.g9f192350.el9.x86_64 2024-04-06T03:27:11.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:27:11.984 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-06T03:27:12.248 DEBUG:teuthology.parallel:result is None 2024-04-06T03:27:12.248 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 2024-04-06T03:27:12.466 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-06T03:27:12.492 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-2027.g9f192350.el9 2024-04-06T03:27:12.493 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2027.g9f192350.el9 2024-04-06T03:27:12.493 INFO:teuthology.task.install:The correct ceph version 19.0.0-2027.g9f192350 is installed. 2024-04-06T03:27:12.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 2024-04-06T03:27:12.714 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-06T03:27:12.735 INFO:teuthology.orchestra.run.smithi102.stdout:19.0.0-2027.g9f192350.el9 2024-04-06T03:27:12.735 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2027.g9f192350.el9 2024-04-06T03:27:12.735 INFO:teuthology.task.install:The correct ceph version 19.0.0-2027.g9f192350 is installed. 2024-04-06T03:27:12.737 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-06T03:27:12.737 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:27:12.737 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-06T03:27:12.769 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:27:12.769 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-06T03:27:12.803 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-06T03:27:12.803 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:27:12.803 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-04-06T03:27:12.840 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-06T03:27:12.910 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:27:12.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-04-06T03:27:12.937 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-06T03:27:13.004 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-06T03:27:13.005 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:27:13.005 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-06T03:27:13.034 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-06T03:27:13.103 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:27:13.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-06T03:27:13.130 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-06T03:27:13.197 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-06T03:27:13.197 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:27:13.197 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-04-06T03:27:13.226 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-06T03:27:13.294 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:27:13.294 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-04-06T03:27:13.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-06T03:27:13.389 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-06T03:27:13.480 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '9f192350ba5fe6d0a365b251a8c2af61f56a5fa6', 'cephadm_mode': 'cephadm-package'} 2024-04-06T03:27:13.480 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 2024-04-06T03:27:13.481 INFO:tasks.cephadm:Cluster fsid is 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:27:13.481 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-06T03:27:13.481 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.47', 'mon.c': '[v2:172.21.15.47:3301,v1:172.21.15.47:6790]', 'mon.b': '172.21.15.102'} 2024-04-06T03:27:13.481 INFO:tasks.cephadm:First mon is mon.a on smithi047 2024-04-06T03:27:13.481 INFO:tasks.cephadm:First mgr is y 2024-04-06T03:27:13.481 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-06T03:27:13.481 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-04-06T03:27:13.510 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname $(hostname -s) 2024-04-06T03:27:13.547 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 on all hosts... 2024-04-06T03:27:13.548 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 pull 2024-04-06T03:27:13.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 pull 2024-04-06T03:27:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6... 2024-04-06T03:27:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6... 2024-04-06T03:27:57.503 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-06T03:27:57.503 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev)", 2024-04-06T03:27:57.503 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880", 2024-04-06T03:27:57.503 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-04-06T03:27:57.503 INFO:teuthology.orchestra.run.smithi047.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c" 2024-04-06T03:27:57.503 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-04-06T03:27:57.504 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-06T03:28:02.180 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-06T03:28:02.180 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev)", 2024-04-06T03:28:02.180 INFO:teuthology.orchestra.run.smithi102.stdout: "image_id": "a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880", 2024-04-06T03:28:02.180 INFO:teuthology.orchestra.run.smithi102.stdout: "repo_digests": [ 2024-04-06T03:28:02.180 INFO:teuthology.orchestra.run.smithi102.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c" 2024-04-06T03:28:02.181 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-06T03:28:02.181 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-06T03:28:02.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-04-06T03:28:02.239 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph 2024-04-06T03:28:02.268 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-04-06T03:28:02.309 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /etc/ceph 2024-04-06T03:28:02.335 INFO:tasks.cephadm:Writing seed config... 2024-04-06T03:28:02.336 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-06T03:28:02.336 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [global] ms type = async 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-06T03:28:02.337 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-04-06T03:28:02.338 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-04-06T03:28:02.338 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-06T03:28:02.338 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:28:02.338 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-06T03:28:02.367 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 mon election default strategy = 1 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-04-06T03:28:02.367 DEBUG:teuthology.orchestra.run.smithi047:mon.a> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a.service 2024-04-06T03:28:02.410 DEBUG:teuthology.orchestra.run.smithi047:mgr.y> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.y.service 2024-04-06T03:28:02.452 INFO:tasks.cephadm:Bootstrapping... 2024-04-06T03:28:02.453 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 -v bootstrap --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.47 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-06T03:28:02.651 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-06T03:28:02.651 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6', '-v', 'bootstrap', '--fsid', '8f6329a8-f3c5-11ee-b649-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.47', '--skip-admin-label'] 2024-04-06T03:28:02.652 INFO:teuthology.orchestra.run.smithi047.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-06T03:28:02.652 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying podman|docker is present... 2024-04-06T03:28:02.676 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-06T03:28:02.676 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying lvm2 is present... 2024-04-06T03:28:02.676 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying time synchronization is in place... 2024-04-06T03:28:02.684 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-06T03:28:02.684 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-06T03:28:02.690 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-06T03:28:02.690 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-04-06T03:28:02.696 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-04-06T03:28:02.702 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-04-06T03:28:02.702 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-04-06T03:28:02.702 INFO:teuthology.orchestra.run.smithi047.stdout:Repeating the final host check... 2024-04-06T03:28:02.725 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-06T03:28:02.725 INFO:teuthology.orchestra.run.smithi047.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-06T03:28:02.725 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl is present 2024-04-06T03:28:02.725 INFO:teuthology.orchestra.run.smithi047.stdout:lvcreate is present 2024-04-06T03:28:02.731 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-06T03:28:02.731 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-06T03:28:02.737 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-06T03:28:02.737 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-04-06T03:28:02.743 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-04-06T03:28:02.749 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-04-06T03:28:02.750 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-04-06T03:28:02.750 INFO:teuthology.orchestra.run.smithi047.stdout:Host looks OK 2024-04-06T03:28:02.750 INFO:teuthology.orchestra.run.smithi047.stdout:Cluster fsid: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:02.750 INFO:teuthology.orchestra.run.smithi047.stdout:Acquiring lock 140469969929168 on /run/cephadm/8f6329a8-f3c5-11ee-b649-cb9ed24678a4.lock 2024-04-06T03:28:02.750 INFO:teuthology.orchestra.run.smithi047.stdout:Lock 140469969929168 acquired on /run/cephadm/8f6329a8-f3c5-11ee-b649-cb9ed24678a4.lock 2024-04-06T03:28:02.750 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 3300 ... 2024-04-06T03:28:02.750 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 6789 ... 2024-04-06T03:28:02.750 INFO:teuthology.orchestra.run.smithi047.stdout:Base mon IP(s) is [172.21.15.47:3300, 172.21.15.47:6789], mon addrv is [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-04-06T03:28:02.753 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.47 metric 100 2024-04-06T03:28:02.753 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.47 metric 100 2024-04-06T03:28:02.756 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-06T03:28:02.756 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-06T03:28:02.756 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-06T03:28:02.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-06T03:28:02.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-06T03:28:02.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-06T03:28:02.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-06T03:28:02.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-04-06T03:28:02.759 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-06T03:28:02.759 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-04-06T03:28:02.759 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-04-06T03:28:02.759 INFO:teuthology.orchestra.run.smithi047.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-06T03:28:02.760 INFO:teuthology.orchestra.run.smithi047.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-06T03:28:02.760 INFO:teuthology.orchestra.run.smithi047.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6... 2024-04-06T03:28:03.168 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 2024-04-06T03:28:03.168 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6... 2024-04-06T03:28:03.168 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Getting image source signatures 2024-04-06T03:28:03.168 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:51f8d622b3f6d10cf8f0adf1c59ac5c379fe641fdb797b80d277530cbbbac99b 2024-04-06T03:28:03.168 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:77070339c81bcb5c53bbbf3f31a47f7187e5393cb0e096452852a31192d97570 2024-04-06T03:28:03.168 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying config sha256:a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 2024-04-06T03:28:03.168 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-06T03:28:04.057 INFO:teuthology.orchestra.run.smithi047.stdout:ceph: stdout ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev) 2024-04-06T03:28:04.057 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph version: ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev) 2024-04-06T03:28:04.057 INFO:teuthology.orchestra.run.smithi047.stdout:Extracting ceph user uid/gid from container image... 2024-04-06T03:28:05.045 INFO:teuthology.orchestra.run.smithi047.stdout:stat: stdout 167 167 2024-04-06T03:28:05.046 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial keys... 2024-04-06T03:28:06.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBFwRBmCcasFhAAaVrYA8I3Q8Tgmy0vuP6IZg== 2024-04-06T03:28:06.891 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBGwRBm2D2SFRAA2hbCghF+5lmIw0ZbLSeTEA== 2024-04-06T03:28:07.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBHwRBmEnt3DhAAeijkvR/2fox10almyttJQg== 2024-04-06T03:28:07.747 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial monmap... 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool for a [v2:172.21.15.47:3300,v1:172.21.15.47:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: set fsid to 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:28:08.677 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mon... 2024-04-06T03:28:09.574 INFO:teuthology.orchestra.run.smithi047.stdout:create mon.a on 2024-04-06T03:28:09.775 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-06T03:28:09.915 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-06T03:28:10.090 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4.target → /etc/systemd/system/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4.target. 2024-04-06T03:28:10.090 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4.target → /etc/systemd/system/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4.target. 2024-04-06T03:28:10.348 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a 2024-04-06T03:28:10.348 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a.service: Unit ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a.service not loaded. 2024-04-06T03:28:10.510 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4.target.wants/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a.service → /etc/systemd/system/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@.service. 2024-04-06T03:28:10.999 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-06T03:28:10.999 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-04-06T03:28:11.006 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-06T03:28:11.006 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-04-06T03:28:11.006 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-04-06T03:28:11.006 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-04-06T03:28:11.006 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon to start... 2024-04-06T03:28:11.007 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon... 2024-04-06T03:28:12.067 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout cluster: 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout id: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout services: 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.528612s) 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout data: 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-06T03:28:12.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pgs: 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.429+0000 7fc2cba3f700 1 Processor -- start 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.429+0000 7fc2cba3f700 1 -- start start 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.429+0000 7fc2cba3f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c407a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.429+0000 7fc2cba3f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c407a9c0 con 0x7fc2c407bf90 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.430+0000 7fc2c97db700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c407a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.430+0000 7fc2c97db700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c407a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42908/0 (socket says 172.21.15.47:42908) 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.430+0000 7fc2c97db700 1 -- 172.21.15.47:0/4028875885 learned_addr learned my addr 172.21.15.47:0/4028875885 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.430+0000 7fc2c97db700 1 -- 172.21.15.47:0/4028875885 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c407ab40 con 0x7fc2c407bf90 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.430+0000 7fc2c97db700 1 --2- 172.21.15.47:0/4028875885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c407a3f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0098a0 tx=0x7fc2bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dca51d0447f7ac server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.430+0000 7fc2c3fff700 1 -- 172.21.15.47:0/4028875885 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2bc004160 con 0x7fc2c407bf90 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2c3fff700 1 -- 172.21.15.47:0/4028875885 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2bc004300 con 0x7fc2c407bf90 2024-04-06T03:28:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2c3fff700 1 -- 172.21.15.47:0/4028875885 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2bc0036a0 con 0x7fc2c407bf90 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2cba3f700 1 -- 172.21.15.47:0/4028875885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 msgr2=0x7fc2c407a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2cba3f700 1 --2- 172.21.15.47:0/4028875885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c407a3f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0098a0 tx=0x7fc2bc009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2cba3f700 1 -- 172.21.15.47:0/4028875885 shutdown_connections 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2cba3f700 1 --2- 172.21.15.47:0/4028875885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c407a3f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2cba3f700 1 -- 172.21.15.47:0/4028875885 >> 172.21.15.47:0/4028875885 conn(0x7fc2c41018c0 msgr2=0x7fc2c4103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2cba3f700 1 -- 172.21.15.47:0/4028875885 shutdown_connections 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.431+0000 7fc2cba3f700 1 -- 172.21.15.47:0/4028875885 wait complete. 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.432+0000 7fc2cba3f700 1 Processor -- start 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.432+0000 7fc2cba3f700 1 -- start start 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.432+0000 7fc2cba3f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.432+0000 7fc2cba3f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c407b070 con 0x7fc2c407bf90 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.432+0000 7fc2c97db700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.432+0000 7fc2c97db700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c419bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42924/0 (socket says 172.21.15.47:42924) 2024-04-06T03:28:12.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.432+0000 7fc2c97db700 1 -- 172.21.15.47:0/1937907862 learned_addr learned my addr 172.21.15.47:0/1937907862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.432+0000 7fc2c97db700 1 -- 172.21.15.47:0/1937907862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c419c0b0 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.433+0000 7fc2c97db700 1 --2- 172.21.15.47:0/1937907862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c419bb70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc000c00 tx=0x7fc2bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.433+0000 7fc2c27fc700 1 -- 172.21.15.47:0/1937907862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2bc003db0 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.433+0000 7fc2c27fc700 1 -- 172.21.15.47:0/1937907862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2bc011630 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.433+0000 7fc2c27fc700 1 -- 172.21.15.47:0/1937907862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2bc011950 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.433+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c419c340 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.433+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c419f030 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.433+0000 7fc2c27fc700 1 -- 172.21.15.47:0/1937907862 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc2bc011af0 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.433+0000 7fc2c27fc700 1 -- 172.21.15.47:0/1937907862 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc2bc01c450 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.434+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c4063900 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.436+0000 7fc2c27fc700 1 -- 172.21.15.47:0/1937907862 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc2bc032020 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.508+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc2c402db70 con 0x7fc2c407bf90 2024-04-06T03:28:12.071 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.509+0000 7fc2c27fc700 1 -- 172.21.15.47:0/1937907862 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fc2bc004260 con 0x7fc2c407bf90 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.509+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 msgr2=0x7fc2c419bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.509+0000 7fc2cba3f700 1 --2- 172.21.15.47:0/1937907862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c419bb70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc000c00 tx=0x7fc2bc004750 comp rx=0 tx=0).stop 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.509+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 shutdown_connections 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.509+0000 7fc2cba3f700 1 --2- 172.21.15.47:0/1937907862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c407bf90 0x7fc2c419bb70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.509+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 >> 172.21.15.47:0/1937907862 conn(0x7fc2c41018c0 msgr2=0x7fc2c4102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.509+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 shutdown_connections 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:11.509+0000 7fc2cba3f700 1 -- 172.21.15.47:0/1937907862 wait complete. 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:mon is available 2024-04-06T03:28:12.072 INFO:teuthology.orchestra.run.smithi047.stdout:Assimilating anything we can from ceph.conf... 2024-04-06T03:28:13.107 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-06T03:28:13.108 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.496+0000 7f68debe6700 1 Processor -- start 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.496+0000 7f68debe6700 1 -- start start 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.496+0000 7f68debe6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d810a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.496+0000 7f68debe6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8108160 con 0x7f68d8109c20 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.496+0000 7f68dc982700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d810a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.496+0000 7f68dc982700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d810a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42938/0 (socket says 172.21.15.47:42938) 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.496+0000 7f68dc982700 1 -- 172.21.15.47:0/2612095705 learned_addr learned my addr 172.21.15.47:0/2612095705 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.496+0000 7f68dc982700 1 -- 172.21.15.47:0/2612095705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d81082e0 con 0x7f68d8109c20 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68dc982700 1 --2- 172.21.15.47:0/2612095705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d810a040 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0098a0 tx=0x7f68cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c492ac83e0c6d21 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68d77fe700 1 -- 172.21.15.47:0/2612095705 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc004160 con 0x7f68d8109c20 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68d77fe700 1 -- 172.21.15.47:0/2612095705 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68cc004300 con 0x7f68d8109c20 2024-04-06T03:28:13.109 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68d77fe700 1 -- 172.21.15.47:0/2612095705 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc0036a0 con 0x7f68d8109c20 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68debe6700 1 -- 172.21.15.47:0/2612095705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 msgr2=0x7f68d810a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68debe6700 1 --2- 172.21.15.47:0/2612095705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d810a040 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0098a0 tx=0x7f68cc009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68debe6700 1 -- 172.21.15.47:0/2612095705 shutdown_connections 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68debe6700 1 --2- 172.21.15.47:0/2612095705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d810a040 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68debe6700 1 -- 172.21.15.47:0/2612095705 >> 172.21.15.47:0/2612095705 conn(0x7f68d807b8f0 msgr2=0x7f68d81065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68debe6700 1 -- 172.21.15.47:0/2612095705 shutdown_connections 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.497+0000 7f68debe6700 1 -- 172.21.15.47:0/2612095705 wait complete. 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.498+0000 7f68debe6700 1 Processor -- start 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.498+0000 7f68debe6700 1 -- start start 2024-04-06T03:28:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.498+0000 7f68debe6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d819bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.498+0000 7f68debe6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8108810 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.498+0000 7f68dc982700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d819bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.498+0000 7f68dc982700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d819bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42946/0 (socket says 172.21.15.47:42946) 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.498+0000 7f68dc982700 1 -- 172.21.15.47:0/3473627773 learned_addr learned my addr 172.21.15.47:0/3473627773 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.498+0000 7f68dc982700 1 -- 172.21.15.47:0/3473627773 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d819c210 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.499+0000 7f68dc982700 1 --2- 172.21.15.47:0/3473627773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d819bcd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f68cc000c00 tx=0x7f68cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.499+0000 7f68d5ffb700 1 -- 172.21.15.47:0/3473627773 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc003db0 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.499+0000 7f68d5ffb700 1 -- 172.21.15.47:0/3473627773 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68cc011630 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.499+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d819c4a0 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.499+0000 7f68d5ffb700 1 -- 172.21.15.47:0/3473627773 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68cc011950 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.499+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d819f180 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.499+0000 7f68d5ffb700 1 -- 172.21.15.47:0/3473627773 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68cc011af0 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.499+0000 7f68d5ffb700 1 -- 172.21.15.47:0/3473627773 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f68cc01c450 con 0x7f68d8109c20 2024-04-06T03:28:13.111 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.500+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d8063900 con 0x7f68d8109c20 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.502+0000 7f68d5ffb700 1 -- 172.21.15.47:0/3473627773 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f68cc032020 con 0x7f68d8109c20 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.572+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f68d81a04d0 con 0x7f68d8109c20 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.575+0000 7f68d5ffb700 1 -- 172.21.15.47:0/3473627773 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+338 (secure 0 0 0) 0x7f68cc004260 con 0x7f68d8109c20 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.575+0000 7f68d5ffb700 1 -- 172.21.15.47:0/3473627773 <== mon.0 v2:172.21.15.47:3300/0 8 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f68cc01c6a0 con 0x7f68d8109c20 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.576+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 msgr2=0x7f68d819bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.576+0000 7f68debe6700 1 --2- 172.21.15.47:0/3473627773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d819bcd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f68cc000c00 tx=0x7f68cc004750 comp rx=0 tx=0).stop 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.576+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 shutdown_connections 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.576+0000 7f68debe6700 1 --2- 172.21.15.47:0/3473627773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68d8109c20 0x7f68d819bcd0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.576+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 >> 172.21.15.47:0/3473627773 conn(0x7f68d807b8f0 msgr2=0x7f68d8192990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.576+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 shutdown_connections 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:12.576+0000 7f68debe6700 1 -- 172.21.15.47:0/3473627773 wait complete. 2024-04-06T03:28:13.112 INFO:teuthology.orchestra.run.smithi047.stdout:Generating new minimal ceph.conf... 2024-04-06T03:28:14.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:13 smithi047 ceph-mon[28990]: from='client.? 172.21.15.47:0/315520623' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.558+0000 7fcedc066700 1 Processor -- start 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.559+0000 7fcedc066700 1 -- start start 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.559+0000 7fcedc066700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced4107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.559+0000 7fcedc066700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fced4105f60 con 0x7fced4107a20 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.559+0000 7fced9e02700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced4107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.559+0000 7fced9e02700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced4107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42962/0 (socket says 172.21.15.47:42962) 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.559+0000 7fced9e02700 1 -- 172.21.15.47:0/1497483770 learned_addr learned my addr 172.21.15.47:0/1497483770 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.560+0000 7fced9e02700 1 -- 172.21.15.47:0/1497483770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced41060e0 con 0x7fced4107a20 2024-04-06T03:28:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.560+0000 7fced9e02700 1 --2- 172.21.15.47:0/1497483770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced4107e40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcec40098a0 tx=0x7fcec4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae43c7b50ef7b18 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.560+0000 7fced8e00700 1 -- 172.21.15.47:0/1497483770 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcec4004160 con 0x7fced4107a20 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.560+0000 7fced8e00700 1 -- 172.21.15.47:0/1497483770 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fcec4004300 con 0x7fced4107a20 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.560+0000 7fced8e00700 1 -- 172.21.15.47:0/1497483770 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcec4011a60 con 0x7fced4107a20 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 -- 172.21.15.47:0/1497483770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 msgr2=0x7fced4107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 --2- 172.21.15.47:0/1497483770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced4107e40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcec40098a0 tx=0x7fcec4009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 -- 172.21.15.47:0/1497483770 shutdown_connections 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 --2- 172.21.15.47:0/1497483770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced4107e40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 -- 172.21.15.47:0/1497483770 >> 172.21.15.47:0/1497483770 conn(0x7fced41018c0 msgr2=0x7fced4103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 -- 172.21.15.47:0/1497483770 shutdown_connections 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 -- 172.21.15.47:0/1497483770 wait complete. 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 Processor -- start 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 -- start start 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced407bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.561+0000 7fcedc066700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fced410a8f0 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fced9e02700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced407bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fced9e02700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced407bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42966/0 (socket says 172.21.15.47:42966) 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fced9e02700 1 -- 172.21.15.47:0/315520623 learned_addr learned my addr 172.21.15.47:0/315520623 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fced9e02700 1 -- 172.21.15.47:0/315520623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced407c1c0 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fced9e02700 1 --2- 172.21.15.47:0/315520623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced407bc80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009fb0 tx=0x7fcec40046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fcecaffd700 1 -- 172.21.15.47:0/315520623 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcec401a430 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fcecaffd700 1 -- 172.21.15.47:0/315520623 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fcec401aa60 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced407a3b0 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fcecaffd700 1 -- 172.21.15.47:0/315520623 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcec40249b0 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced407a8f0 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fcecaffd700 1 -- 172.21.15.47:0/315520623 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcec4022020 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.562+0000 7fcecaffd700 1 -- 172.21.15.47:0/315520623 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcec40196d0 con 0x7fced4107a20 2024-04-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.563+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced4063900 con 0x7fced4107a20 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.565+0000 7fcecaffd700 1 -- 172.21.15.47:0/315520623 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcec401a5d0 con 0x7fced4107a20 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.636+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fced407acd0 con 0x7fced4107a20 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.636+0000 7fcecaffd700 1 -- 172.21.15.47:0/315520623 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fcec401a7b0 con 0x7fced4107a20 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.637+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 msgr2=0x7fced407bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.637+0000 7fcedc066700 1 --2- 172.21.15.47:0/315520623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced407bc80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009fb0 tx=0x7fcec40046a0 comp rx=0 tx=0).stop 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.637+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 shutdown_connections 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.637+0000 7fcedc066700 1 --2- 172.21.15.47:0/315520623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fced4107a20 0x7fced407bc80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.637+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 >> 172.21.15.47:0/315520623 conn(0x7fced41018c0 msgr2=0x7fced4102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.637+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 shutdown_connections 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:13.637+0000 7fcedc066700 1 -- 172.21.15.47:0/315520623 wait complete. 2024-04-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:Restarting the monitor... 2024-04-06T03:28:14.450 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:14 smithi047 systemd[1]: Stopping Ceph mon.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:28:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:14 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a[28986]: 2024-04-06T03:28:14.449+0000 7fcbe9daf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T03:28:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:14 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a[28986]: 2024-04-06T03:28:14.449+0000 7fcbe9daf700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-06T03:28:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:14 smithi047 podman[29236]: 2024-04-06 03:28:14.480899004 +0000 UTC m=+0.122706969 container died d08eef48aa9990b1d3059592a69c0c18af21cb2885c4ad7d60cb1165dd6a847a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-9f19235, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-04-06T03:28:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:14 smithi047 podman[29236]: 2024-04-06 03:28:14.782512647 +0000 UTC m=+0.424320621 container cleanup d08eef48aa9990b1d3059592a69c0c18af21cb2885c4ad7d60cb1165dd6a847a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-9f19235) 2024-04-06T03:28:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:14 smithi047 bash[29236]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a 2024-04-06T03:28:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:14 smithi047 podman[29251]: 2024-04-06 03:28:14.967003585 +0000 UTC m=+0.490919791 container remove d08eef48aa9990b1d3059592a69c0c18af21cb2885c4ad7d60cb1165dd6a847a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-06T03:28:15.354 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:15 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-04-06T03:28:15.355 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:15 smithi047 systemd[1]: Stopped Ceph mon.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:28:15.355 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:15 smithi047 systemd[1]: Starting Ceph mon.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:28:15.355 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:15 smithi047 podman[29346]: 2024-04-06 03:28:15.218952364 +0000 UTC m=+0.017722244 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 2024-04-06T03:28:15.355 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:15 smithi047 podman[29346]: 2024-04-06 03:28:15.355377836 +0000 UTC m=+0.154147693 container create 7ca29cac51cd7d87880ae2539a25ca09e546f4040365c7ee0224a9990effa7cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240403, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9f19235, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-06T03:28:17.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 podman[29346]: 2024-04-06 03:28:17.23858263 +0000 UTC m=+2.037352490 container init 7ca29cac51cd7d87880ae2539a25ca09e546f4040365c7ee0224a9990effa7cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T03:28:17.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 podman[29346]: 2024-04-06 03:28:17.242341675 +0000 UTC m=+2.041111535 container start 7ca29cac51cd7d87880ae2539a25ca09e546f4040365c7ee0224a9990effa7cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235) 2024-04-06T03:28:17.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: set uid:gid to 167:167 (ceph:ceph) 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev), process ceph-mon, pid 2 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: pidfile_write: ignore empty --pid-file 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: load: jerasure load: lrc 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: RocksDB version: 7.9.2 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Git sha 0 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Compile date 2024-04-05 08:39:05 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: DB SUMMARY 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: DB Session ID: O3SA6MPGL2P3U1DSE0OC 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: CURRENT file: CURRENT 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: IDENTITY file: IDENTITY 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-06T03:28:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 91843 ; 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.error_if_exists: 0 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.create_if_missing: 0 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.paranoid_checks: 1 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.env: 0x5594f9eebc60 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.fs: PosixFileSystem 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.info_log: 0x5594fc44fae0 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_file_opening_threads: 16 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.statistics: (nil) 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.use_fsync: 0 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_log_file_size: 0 2024-04-06T03:28:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.keep_log_file_num: 1000 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.recycle_log_file_num: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.allow_fallocate: 1 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.allow_mmap_reads: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.allow_mmap_writes: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.use_direct_reads: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.create_missing_column_families: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.db_log_dir: 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.wal_dir: 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-06T03:28:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.advise_random_on_open: 1 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.db_write_buffer_size: 0 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.write_buffer_manager: 0x5594fc4221e0 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.rate_limiter: (nil) 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.wal_recovery_mode: 2 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.enable_thread_tracking: 0 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.enable_pipelined_write: 0 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.unordered_write: 0 2024-04-06T03:28:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-06T03:28:17.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-06T03:28:17.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-06T03:28:17.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-06T03:28:17.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.row_cache: None 2024-04-06T03:28:17.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.wal_filter: None 2024-04-06T03:28:17.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-06T03:28:17.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.allow_ingest_behind: 0 2024-04-06T03:28:17.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.two_write_queues: 0 2024-04-06T03:28:17.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.manual_wal_flush: 0 2024-04-06T03:28:17.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.wal_compression: 0 2024-04-06T03:28:17.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.atomic_flush: 0 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.log_readahead_size: 0 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.best_efforts_recovery: 0 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.allow_data_in_errors: 0 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.db_host_id: __hostname__ 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_background_jobs: 2 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_background_compactions: -1 2024-04-06T03:28:17.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_subcompactions: 1 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_total_wal_size: 0 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_open_files: -1 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bytes_per_sync: 0 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_readahead_size: 0 2024-04-06T03:28:17.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_background_flushes: -1 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Compression algorithms supported: 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: kZSTD supported: 0 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: kXpressCompression supported: 0 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: kLZ4HCCompression supported: 1 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: kZlibCompression supported: 1 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: kSnappyCompression supported: 1 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: kLZ4Compression supported: 1 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: kBZip2Compression supported: 0 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-06T03:28:17.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.merge_operator: 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_filter: None 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_filter_factory: None 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.sst_partitioner_factory: None 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5594fc44fbe0) 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_type: 0 2024-04-06T03:28:17.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_index_type: 0 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_shortening: 1 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: checksum: 4 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: no_block_cache: 0 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache: 0x5594fc453090 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_options: 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: capacity : 536870912 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_shard_bits : 4 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: strict_capacity_limit : 0 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_compressed: (nil) 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: persistent_cache: (nil) 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size: 4096 2024-04-06T03:28:17.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size_deviation: 10 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_restart_interval: 16 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_block_restart_interval: 1 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: metadata_block_size: 4096 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: partition_filters: 0 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: use_delta_encoding: 1 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: filter_policy: bloomfilter 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: whole_key_filtering: 1 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: verify_compression: 0 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: format_version: 5 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_index_compression: 1 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_align: 0 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: max_auto_readahead_size: 262144 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: prepopulate_block_cache: 0 2024-04-06T03:28:17.504 INFO:journalctl@ceph.mon.a.smithi047.stdout: initial_auto_readahead_size: 8192 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.write_buffer_size: 33554432 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_write_buffer_number: 2 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression: NoCompression 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression: Disabled 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.prefix_extractor: nullptr 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.num_levels: 7 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-06T03:28:17.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.level: 32767 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.strategy: 0 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-06T03:28:17.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.enabled: false 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.target_file_size_base: 67108864 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-06T03:28:17.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.arena_block_size: 1048576 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.disable_auto_compactions: 0 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-06T03:28:17.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.table_properties_collectors: 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.inplace_update_support: 0 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.bloom_locality: 0 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.max_successive_merges: 0 2024-04-06T03:28:17.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.paranoid_file_checks: 0 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.force_consistency_checks: 1 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.report_bg_io_stats: 0 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.ttl: 2592000 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.enable_blob_files: false 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.min_blob_size: 0 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.blob_file_size: 268435456 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-06T03:28:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.blob_file_starting_level: 0 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 20e18654-728f-45be-9dbf-f57d69b83a10 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374097276448, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-06T03:28:17.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374097277437, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 88121, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 272, "table_properties": {"data_size": 86222, "index_size": 245, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 10988, "raw_average_key_size": 47, "raw_value_size": 80097, "raw_average_value_size": 346, "num_data_blocks": 11, "num_entries": 231, "num_filter_entries": 231, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712374097, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "20e18654-728f-45be-9dbf-f57d69b83a10", "db_session_id": "O3SA6MPGL2P3U1DSE0OC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374097277537, "job": 1, "event": "recovery_finished"} 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5594fc544000 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: DB pointer 0x5594fc52e000 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** DB Stats ** 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T03:28:17.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: L0 2/0 87.89 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Sum 2/0 87.89 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T03:28:17.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 129.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative compaction: 0.00 GB write, 23.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval compaction: 0.00 GB write, 23.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T03:28:17.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache BinnedLRUCache@0x5594fc453090#2 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: starting mon.a rank 0 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: mon.a@-1(???) e1 preinit fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: mon.a@-1(???).mds e1 new map 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: mon.a@-1(???).mds e1 print_map 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout: e1 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout: legacy client fscid: -1 2024-04-06T03:28:17.515 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-04-06T03:28:17.516 INFO:journalctl@ceph.mon.a.smithi047.stdout: No filesystems configured 2024-04-06T03:28:17.516 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-06T03:28:17.516 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:28:17.516 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:28:17.516 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:28:17.516 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:17 smithi047 ceph-mon[29365]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-06T03:28:18.121 INFO:teuthology.orchestra.run.smithi047.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-06T03:28:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 bash[29346]: 7ca29cac51cd7d87880ae2539a25ca09e546f4040365c7ee0224a9990effa7cf 2024-04-06T03:28:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 systemd[1]: Started Ceph mon.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:28:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-06T03:28:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: monmap epoch 1 2024-04-06T03:28:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: last_changed 2024-04-06T03:28:08.062065+0000 2024-04-06T03:28:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: created 2024-04-06T03:28:08.062065+0000 2024-04-06T03:28:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: min_mon_release 19 (squid) 2024-04-06T03:28:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: election_strategy: 1 2024-04-06T03:28:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-06T03:28:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: fsmap 2024-04-06T03:28:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: osdmap e1: 0 total, 0 up, 0 in 2024-04-06T03:28:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:18 smithi047 ceph-mon[29365]: mgrmap e1: no daemons active 2024-04-06T03:28:22.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1548494423' entity='client.admin' 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.953+0000 7fd69256e700 1 Processor -- start 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.953+0000 7fd69256e700 1 -- start start 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.953+0000 7fd69256e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c105660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.953+0000 7fd69256e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c105c30 con 0x7fd68c105240 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.954+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c105660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.954+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c105660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52718/0 (socket says 172.21.15.47:52718) 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.954+0000 7fd68bfff700 1 -- 172.21.15.47:0/1161757488 learned_addr learned my addr 172.21.15.47:0/1161757488 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.954+0000 7fd68bfff700 1 -- 172.21.15.47:0/1161757488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c106440 con 0x7fd68c105240 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.954+0000 7fd68bfff700 1 --2- 172.21.15.47:0/1161757488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c105660 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd6740098a0 tx=0x7fd674009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9d7aa9b94ce269 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.954+0000 7fd68affd700 1 -- 172.21.15.47:0/1161757488 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd674004160 con 0x7fd68c105240 2024-04-06T03:28:26.251 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.954+0000 7fd68affd700 1 -- 172.21.15.47:0/1161757488 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fd674004300 con 0x7fd68c105240 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.954+0000 7fd68affd700 1 -- 172.21.15.47:0/1161757488 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd674011a60 con 0x7fd68c105240 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 -- 172.21.15.47:0/1161757488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 msgr2=0x7fd68c105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 --2- 172.21.15.47:0/1161757488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c105660 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd6740098a0 tx=0x7fd674009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 -- 172.21.15.47:0/1161757488 shutdown_connections 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 --2- 172.21.15.47:0/1161757488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c105660 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 -- 172.21.15.47:0/1161757488 >> 172.21.15.47:0/1161757488 conn(0x7fd68c100820 msgr2=0x7fd68c102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 -- 172.21.15.47:0/1161757488 shutdown_connections 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 -- 172.21.15.47:0/1161757488 wait complete. 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 Processor -- start 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.955+0000 7fd69256e700 1 -- start start 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd69256e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c079b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd69256e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c109670 con 0x7fd68c105240 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c079b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:26.252 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c079b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52726/0 (socket says 172.21.15.47:52726) 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd68bfff700 1 -- 172.21.15.47:0/1548494423 learned_addr learned my addr 172.21.15.47:0/1548494423 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd68bfff700 1 -- 172.21.15.47:0/1548494423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c19cee0 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd68bfff700 1 --2- 172.21.15.47:0/1548494423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c079b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd674011700 tx=0x7fd6740046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd6897fa700 1 -- 172.21.15.47:0/1548494423 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd674003b20 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd6897fa700 1 -- 172.21.15.47:0/1548494423 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fd67401a8c0 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c19d0b0 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.956+0000 7fd6897fa700 1 -- 172.21.15.47:0/1548494423 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6740249a0 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.957+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c19d4d0 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.957+0000 7fd6897fa700 1 -- 172.21.15.47:0/1548494423 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd674022020 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.957+0000 7fd6897fa700 1 -- 172.21.15.47:0/1548494423 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd674019710 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.957+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd68c1097f0 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:20.960+0000 7fd6897fa700 1 -- 172.21.15.47:0/1548494423 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd67401aa70 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.030+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fd68c19da70 con 0x7fd68c105240 2024-04-06T03:28:26.253 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.032+0000 7fd6897fa700 1 -- 172.21.15.47:0/1548494423 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fd67401a430 con 0x7fd68c105240 2024-04-06T03:28:26.254 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.032+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 msgr2=0x7fd68c079b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:26.254 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.032+0000 7fd69256e700 1 --2- 172.21.15.47:0/1548494423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c079b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd674011700 tx=0x7fd6740046a0 comp rx=0 tx=0).stop 2024-04-06T03:28:26.254 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.032+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 shutdown_connections 2024-04-06T03:28:26.254 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.032+0000 7fd69256e700 1 --2- 172.21.15.47:0/1548494423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd68c105240 0x7fd68c079b80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:26.254 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.032+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 >> 172.21.15.47:0/1548494423 conn(0x7fd68c100820 msgr2=0x7fd68c101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:26.254 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.032+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 shutdown_connections 2024-04-06T03:28:26.254 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:21.032+0000 7fd69256e700 1 -- 172.21.15.47:0/1548494423 wait complete. 2024-04-06T03:28:26.254 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-06T03:28:26.276 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-06T03:28:26.276 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mgr... 2024-04-06T03:28:26.277 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-06T03:28:26.277 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-06T03:28:26.534 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.y 2024-04-06T03:28:26.534 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.y.service: Unit ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.y.service not loaded. 2024-04-06T03:28:26.678 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4.target.wants/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.y.service → /etc/systemd/system/ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@.service. 2024-04-06T03:28:26.907 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:26 smithi047 systemd[1]: Starting Ceph mgr.y for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:28:27.173 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:26 smithi047 podman[29579]: 2024-04-06 03:28:26.810251211 +0000 UTC m=+0.017827658 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 2024-04-06T03:28:27.173 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:26 smithi047 podman[29579]: 2024-04-06 03:28:26.91254487 +0000 UTC m=+0.120121316 container create a233835f566392af95cd4efba5dffdd069305ebd198087f0d5f127f4850faeea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-06T03:28:27.173 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:27 smithi047 podman[29579]: 2024-04-06 03:28:27.123581708 +0000 UTC m=+0.331158155 container init a233835f566392af95cd4efba5dffdd069305ebd198087f0d5f127f4850faeea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9f19235, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, ceph=True) 2024-04-06T03:28:27.174 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:27 smithi047 podman[29579]: 2024-04-06 03:28:27.125976525 +0000 UTC m=+0.333552983 container start a233835f566392af95cd4efba5dffdd069305ebd198087f0d5f127f4850faeea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, RELEASE=squid-9f19235, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-06T03:28:27.174 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:27 smithi047 bash[29579]: a233835f566392af95cd4efba5dffdd069305ebd198087f0d5f127f4850faeea 2024-04-06T03:28:27.186 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-06T03:28:27.186 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-04-06T03:28:27.193 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-06T03:28:27.193 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-04-06T03:28:27.194 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-04-06T03:28:27.194 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-04-06T03:28:27.202 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-06T03:28:27.202 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-04-06T03:28:27.209 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-06T03:28:27.209 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-04-06T03:28:27.209 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-04-06T03:28:27.209 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-06T03:28:27.209 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr to start... 2024-04-06T03:28:27.209 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr... 2024-04-06T03:28:27.424 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:27 smithi047 systemd[1]: Started Ceph mgr.y for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:28:27.991 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3211968695' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-06T03:28:27.992 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:27 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:27.694+0000 7ff1e8080200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-06T03:28:27.992 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:27 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:27.796+0000 7ff1e8080200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-06T03:28:28.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:28.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-04-06T03:28:28.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "8f6329a8-f3c5-11ee-b649-cb9ed24678a4", 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-06T03:28:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-06T03:28:28.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-06T03:28:28.303 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-06T03:28:28.303 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-06T03:28:28.303 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-06T03:28:28.303 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:28.303 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-06T03:28:28.303 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-06T03:28:28.303 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-06T03:28:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-04-06T03:28:10.982386+0000", 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-06T03:28:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.644+0000 7f5e35a08700 1 Processor -- start 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.645+0000 7f5e35a08700 1 -- start start 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.645+0000 7f5e35a08700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e30106720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.645+0000 7f5e35a08700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5e30106cf0 con 0x7f5e30106300 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.645+0000 7f5e2effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e30106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.645+0000 7f5e2effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e30106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58134/0 (socket says 172.21.15.47:58134) 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.645+0000 7f5e2effd700 1 -- 172.21.15.47:0/56458757 learned_addr learned my addr 172.21.15.47:0/56458757 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.645+0000 7f5e2effd700 1 -- 172.21.15.47:0/56458757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e30107500 con 0x7f5e30106300 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e2effd700 1 --2- 172.21.15.47:0/56458757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e30106720 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5e200098a0 tx=0x7f5e20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263a5987e8af23d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e2dffb700 1 -- 172.21.15.47:0/56458757 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e20004160 con 0x7f5e30106300 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e2dffb700 1 -- 172.21.15.47:0/56458757 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f5e20004300 con 0x7f5e30106300 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e2dffb700 1 -- 172.21.15.47:0/56458757 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e20011a60 con 0x7f5e30106300 2024-04-06T03:28:28.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e35a08700 1 -- 172.21.15.47:0/56458757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 msgr2=0x7f5e30106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e35a08700 1 --2- 172.21.15.47:0/56458757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e30106720 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5e200098a0 tx=0x7f5e20009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e35a08700 1 -- 172.21.15.47:0/56458757 shutdown_connections 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e35a08700 1 --2- 172.21.15.47:0/56458757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e30106720 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e35a08700 1 -- 172.21.15.47:0/56458757 >> 172.21.15.47:0/56458757 conn(0x7f5e301018c0 msgr2=0x7f5e30103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e35a08700 1 -- 172.21.15.47:0/56458757 shutdown_connections 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.646+0000 7f5e35a08700 1 -- 172.21.15.47:0/56458757 wait complete. 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.647+0000 7f5e35a08700 1 Processor -- start 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.647+0000 7f5e35a08700 1 -- start start 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.647+0000 7f5e35a08700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e3019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.647+0000 7f5e35a08700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3010a730 con 0x7f5e30106300 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e2effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e3019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e2effd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e3019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58150/0 (socket says 172.21.15.47:58150) 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e2effd700 1 -- 172.21.15.47:0/3211968695 learned_addr learned my addr 172.21.15.47:0/3211968695 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e2effd700 1 -- 172.21.15.47:0/3211968695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3019a6b0 con 0x7f5e30106300 2024-04-06T03:28:28.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e2effd700 1 --2- 172.21.15.47:0/3211968695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e3019a170 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009fb0 tx=0x7f5e200046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e34a06700 1 -- 172.21.15.47:0/3211968695 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2001a430 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e34a06700 1 -- 172.21.15.47:0/3211968695 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f5e2001aa60 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3019a940 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e34a06700 1 -- 172.21.15.47:0/3211968695 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e200249b0 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3019d630 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e34a06700 1 -- 172.21.15.47:0/3211968695 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e20022020 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.648+0000 7f5e34a06700 1 -- 172.21.15.47:0/3211968695 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5e200196d0 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.649+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3010a8b0 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.651+0000 7f5e34a06700 1 -- 172.21.15.47:0/3211968695 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5e2001a5d0 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.726+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5e3019d980 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.726+0000 7f5e34a06700 1 -- 172.21.15.47:0/3211968695 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f5e2001a7b0 con 0x7f5e30106300 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.727+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 msgr2=0x7f5e3019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.727+0000 7f5e35a08700 1 --2- 172.21.15.47:0/3211968695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e3019a170 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009fb0 tx=0x7f5e200046a0 comp rx=0 tx=0).stop 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.727+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 shutdown_connections 2024-04-06T03:28:28.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.727+0000 7f5e35a08700 1 --2- 172.21.15.47:0/3211968695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e30106300 0x7f5e3019a170 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:28.309 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.727+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 >> 172.21.15.47:0/3211968695 conn(0x7f5e301018c0 msgr2=0x7f5e30102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:28.309 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.727+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 shutdown_connections 2024-04-06T03:28:28.309 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:27.727+0000 7f5e35a08700 1 -- 172.21.15.47:0/3211968695 wait complete. 2024-04-06T03:28:28.309 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (1/15)... 2024-04-06T03:28:28.741 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:28 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:28.469+0000 7ff1e8080200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-06T03:28:28.741 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:28 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:28.564+0000 7ff1e8080200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-06T03:28:28.742 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:28 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:28.707+0000 7ff1e8080200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-06T03:28:29.022 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:28 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:28.808+0000 7ff1e8080200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-06T03:28:29.022 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:28 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:28.894+0000 7ff1e8080200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-06T03:28:29.286 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:29 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:29.169+0000 7ff1e8080200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-06T03:28:29.654 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:29 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:29.285+0000 7ff1e8080200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-06T03:28:29.655 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:29 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:29.375+0000 7ff1e8080200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-06T03:28:29.655 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:29 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:29.475+0000 7ff1e8080200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-06T03:28:29.655 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:29 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:29.654+0000 7ff1e8080200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-06T03:28:30.682 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:30.669+0000 7ff1e8080200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-06T03:28:30.991 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2358270007' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-06T03:28:30.992 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:30.809+0000 7ff1e8080200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-06T03:28:31.457 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:31 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:31.164+0000 7ff1e8080200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-06T03:28:31.457 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:31 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:31.256+0000 7ff1e8080200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-06T03:28:31.457 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:31 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:31.456+0000 7ff1e8080200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:28:31.741 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:31 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:31.647+0000 7ff1e8080200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-06T03:28:32.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:32.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-04-06T03:28:32.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "8f6329a8-f3c5-11ee-b649-cb9ed24678a4", 2024-04-06T03:28:32.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-04-06T03:28:32.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-06T03:28:32.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-06T03:28:32.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-06T03:28:32.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-06T03:28:32.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:32.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-06T03:28:32.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-06T03:28:32.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-06T03:28:32.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-06T03:28:32.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-06T03:28:32.195 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:32.196 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-06T03:28:32.197 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-04-06T03:28:10.982386+0000", 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.715+0000 7f1afb4cf700 1 Processor -- start 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.715+0000 7f1afb4cf700 1 -- start start 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.715+0000 7f1afb4cf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af41091b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.715+0000 7f1afb4cf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41096f0 con 0x7f1af4106dc0 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.715+0000 7f1af926b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af41091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.715+0000 7f1af926b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af41091b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58156/0 (socket says 172.21.15.47:58156) 2024-04-06T03:28:32.198 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.715+0000 7f1af926b700 1 -- 172.21.15.47:0/477822739 learned_addr learned my addr 172.21.15.47:0/477822739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.716+0000 7f1af926b700 1 -- 172.21.15.47:0/477822739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af4109870 con 0x7f1af4106dc0 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.716+0000 7f1af926b700 1 --2- 172.21.15.47:0/477822739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af41091b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1af00098a0 tx=0x7f1af0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7974f94bf82e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.716+0000 7f1aebfff700 1 -- 172.21.15.47:0/477822739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af0004160 con 0x7f1af4106dc0 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.716+0000 7f1aebfff700 1 -- 172.21.15.47:0/477822739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f1af0004300 con 0x7f1af4106dc0 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.716+0000 7f1aebfff700 1 -- 172.21.15.47:0/477822739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af0011a60 con 0x7f1af4106dc0 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.717+0000 7f1afb4cf700 1 -- 172.21.15.47:0/477822739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 msgr2=0x7f1af41091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.717+0000 7f1afb4cf700 1 --2- 172.21.15.47:0/477822739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af41091b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1af00098a0 tx=0x7f1af0009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.717+0000 7f1afb4cf700 1 -- 172.21.15.47:0/477822739 shutdown_connections 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.717+0000 7f1afb4cf700 1 --2- 172.21.15.47:0/477822739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af41091b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.717+0000 7f1afb4cf700 1 -- 172.21.15.47:0/477822739 >> 172.21.15.47:0/477822739 conn(0x7f1af4100870 msgr2=0x7f1af4102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.717+0000 7f1afb4cf700 1 -- 172.21.15.47:0/477822739 shutdown_connections 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.717+0000 7f1afb4cf700 1 -- 172.21.15.47:0/477822739 wait complete. 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.717+0000 7f1afb4cf700 1 Processor -- start 2024-04-06T03:28:32.199 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1afb4cf700 1 -- start start 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1afb4cf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af4106640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1afb4cf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1af410a760 con 0x7f1af4106dc0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1af926b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af4106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1af926b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af4106640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58168/0 (socket says 172.21.15.47:58168) 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1af926b700 1 -- 172.21.15.47:0/2358270007 learned_addr learned my addr 172.21.15.47:0/2358270007 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1af926b700 1 -- 172.21.15.47:0/2358270007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af4106b80 con 0x7f1af4106dc0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1af926b700 1 --2- 172.21.15.47:0/2358270007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af4106640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009870 tx=0x7f1af0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1aea7fc700 1 -- 172.21.15.47:0/2358270007 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af001a430 con 0x7f1af4106dc0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1aea7fc700 1 -- 172.21.15.47:0/2358270007 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f1af001aa60 con 0x7f1af4106dc0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.718+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af4104d70 con 0x7f1af4106dc0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.719+0000 7f1aea7fc700 1 -- 172.21.15.47:0/2358270007 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af00199a0 con 0x7f1af4106dc0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.719+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af41052b0 con 0x7f1af4106dc0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.719+0000 7f1aea7fc700 1 -- 172.21.15.47:0/2358270007 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1af0022020 con 0x7f1af4106dc0 2024-04-06T03:28:32.200 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.719+0000 7f1aea7fc700 1 -- 172.21.15.47:0/2358270007 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1af002c3a0 con 0x7f1af4106dc0 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.719+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af4063900 con 0x7f1af4106dc0 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.723+0000 7f1aea7fc700 1 -- 172.21.15.47:0/2358270007 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1af0004300 con 0x7f1af4106dc0 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.798+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1af4105740 con 0x7f1af4106dc0 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.798+0000 7f1aea7fc700 1 -- 172.21.15.47:0/2358270007 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f1af001ac10 con 0x7f1af4106dc0 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.799+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 msgr2=0x7f1af4106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.799+0000 7f1afb4cf700 1 --2- 172.21.15.47:0/2358270007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af4106640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009870 tx=0x7f1af0011ae0 comp rx=0 tx=0).stop 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.799+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 shutdown_connections 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.799+0000 7f1afb4cf700 1 --2- 172.21.15.47:0/2358270007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af4106dc0 0x7f1af4106640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.799+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 >> 172.21.15.47:0/2358270007 conn(0x7f1af4100870 msgr2=0x7f1af4101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.799+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 shutdown_connections 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:30.799+0000 7f1afb4cf700 1 -- 172.21.15.47:0/2358270007 wait complete. 2024-04-06T03:28:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (2/15)... 2024-04-06T03:28:32.202 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:31 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:31.938+0000 7ff1e8080200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:28:32.202 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:32 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:32.201+0000 7ff1e8080200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-06T03:28:32.491 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:32 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:32.446+0000 7ff1e8080200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-06T03:28:33.741 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:33.275+0000 7ff1e8080200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-06T03:28:34.182 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:33.859+0000 7ff1e8080200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-06T03:28:34.182 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:33.959+0000 7ff1e8080200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-06T03:28:34.182 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:34.182+0000 7ff1e8080200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: Activating manager daemon y 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: mgrmap e2: y(active, starting, since 0.00303457s) 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: Manager daemon y is now available 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' 2024-04-06T03:28:34.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' 2024-04-06T03:28:34.445 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:34 smithi047 ceph-mon[29365]: from='mgr.14100 172.21.15.47:0/2791895453' entity='mgr.y' 2024-04-06T03:28:35.291 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "8f6329a8-f3c5-11ee-b649-cb9ed24678a4", 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-04-06T03:28:35.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-06T03:28:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-06T03:28:35.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-04-06T03:28:35.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-04-06T03:28:10.982386+0000", 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.632+0000 7f8dcacba700 1 Processor -- start 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.632+0000 7f8dcacba700 1 -- start start 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.632+0000 7f8dcacba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc4109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:35.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.632+0000 7f8dcacba700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4079f40 con 0x7f8dc4106e30 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.632+0000 7f8dc8a56700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc4109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.632+0000 7f8dc8a56700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc4109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58224/0 (socket says 172.21.15.47:58224) 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.632+0000 7f8dc8a56700 1 -- 172.21.15.47:0/4275829390 learned_addr learned my addr 172.21.15.47:0/4275829390 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.633+0000 7f8dc8a56700 1 -- 172.21.15.47:0/4275829390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc4109760 con 0x7f8dc4106e30 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.633+0000 7f8dc8a56700 1 --2- 172.21.15.47:0/4275829390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc4109220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009e80 tx=0x7f8dbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d300c0156085efa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.633+0000 7f8dc37fe700 1 -- 172.21.15.47:0/4275829390 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc017070 con 0x7f8dc4106e30 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.633+0000 7f8dc37fe700 1 -- 172.21.15.47:0/4275829390 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f8dbc00b8c0 con 0x7f8dc4106e30 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.633+0000 7f8dc37fe700 1 -- 172.21.15.47:0/4275829390 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc004470 con 0x7f8dc4106e30 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 -- 172.21.15.47:0/4275829390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 msgr2=0x7f8dc4109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 --2- 172.21.15.47:0/4275829390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc4109220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009e80 tx=0x7f8dbc00b330 comp rx=0 tx=0).stop 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 -- 172.21.15.47:0/4275829390 shutdown_connections 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 --2- 172.21.15.47:0/4275829390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc4109220 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 -- 172.21.15.47:0/4275829390 >> 172.21.15.47:0/4275829390 conn(0x7f8dc4100820 msgr2=0x7f8dc4102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:35.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 -- 172.21.15.47:0/4275829390 shutdown_connections 2024-04-06T03:28:35.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 -- 172.21.15.47:0/4275829390 wait complete. 2024-04-06T03:28:35.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 Processor -- start 2024-04-06T03:28:35.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 -- start start 2024-04-06T03:28:35.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:35.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.634+0000 7f8dcacba700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc410a650 con 0x7f8dc4106e30 2024-04-06T03:28:35.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dc8a56700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:35.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dc8a56700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc419c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58226/0 (socket says 172.21.15.47:58226) 2024-04-06T03:28:35.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dc8a56700 1 -- 172.21.15.47:0/3993291156 learned_addr learned my addr 172.21.15.47:0/3993291156 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:35.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dc8a56700 1 -- 172.21.15.47:0/3993291156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc419c8d0 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dc8a56700 1 --2- 172.21.15.47:0/3993291156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc419c390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0072a0 tx=0x7f8dbc009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dc1ffb700 1 -- 172.21.15.47:0/3993291156 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc021020 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dc1ffb700 1 -- 172.21.15.47:0/3993291156 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f8dbc003d40 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc419cb60 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dc1ffb700 1 -- 172.21.15.47:0/3993291156 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc017040 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.635+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc419f850 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.636+0000 7f8dc1ffb700 1 -- 172.21.15.47:0/3993291156 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 2) ==== 45871+0+0 (secure 0 0 0) 0x7f8dbc024020 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.636+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc4063900 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.636+0000 7f8dc1ffb700 1 -- 172.21.15.47:0/3993291156 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8dbc00f050 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.638+0000 7f8dc1ffb700 1 -- 172.21.15.47:0/3993291156 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8dbc02b020 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.711+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8dc419fc70 con 0x7f8dc4106e30 2024-04-06T03:28:35.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.712+0000 7f8dc1ffb700 1 -- 172.21.15.47:0/3993291156 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f8dbc018280 con 0x7f8dc4106e30 2024-04-06T03:28:35.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.713+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 msgr2=0x7f8dc419c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:35.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.713+0000 7f8dcacba700 1 --2- 172.21.15.47:0/3993291156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc419c390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0072a0 tx=0x7f8dbc009610 comp rx=0 tx=0).stop 2024-04-06T03:28:35.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.713+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 shutdown_connections 2024-04-06T03:28:35.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.713+0000 7f8dcacba700 1 --2- 172.21.15.47:0/3993291156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc4106e30 0x7f8dc419c390 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:35.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.713+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 >> 172.21.15.47:0/3993291156 conn(0x7f8dc4100820 msgr2=0x7f8dc41011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:35.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.713+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 shutdown_connections 2024-04-06T03:28:35.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:34.713+0000 7f8dcacba700 1 -- 172.21.15.47:0/3993291156 wait complete. 2024-04-06T03:28:35.301 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (3/15)... 2024-04-06T03:28:35.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3993291156' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-06T03:28:35.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:35 smithi047 ceph-mon[29365]: mgrmap e3: y(active, since 1.00588s) 2024-04-06T03:28:37.517 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:37 smithi047 ceph-mon[29365]: mgrmap e4: y(active, since 2s) 2024-04-06T03:28:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1969037047' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-06T03:28:38.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:38.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "8f6329a8-f3c5-11ee-b649-cb9ed24678a4", 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 20, 2024-04-06T03:28:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-06T03:28:38.600 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-06T03:28:38.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-06T03:28:38.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-04-06T03:28:10.982386+0000", 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.727+0000 7f2e9051e700 1 Processor -- start 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.728+0000 7f2e9051e700 1 -- start start 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.728+0000 7f2e9051e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e88107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.728+0000 7f2e9051e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88105f60 con 0x7f2e88107a20 2024-04-06T03:28:38.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.728+0000 7f2e8e2ba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e88107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.728+0000 7f2e8e2ba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e88107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60210/0 (socket says 172.21.15.47:60210) 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.728+0000 7f2e8e2ba700 1 -- 172.21.15.47:0/2490514544 learned_addr learned my addr 172.21.15.47:0/2490514544 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.728+0000 7f2e8e2ba700 1 -- 172.21.15.47:0/2490514544 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e881060e0 con 0x7f2e88107a20 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e8e2ba700 1 --2- 172.21.15.47:0/2490514544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e88107e40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2e840098a0 tx=0x7f2e84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771231c5babc779e server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e8d2b8700 1 -- 172.21.15.47:0/2490514544 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e84004160 con 0x7f2e88107a20 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e8d2b8700 1 -- 172.21.15.47:0/2490514544 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f2e84004300 con 0x7f2e88107a20 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e8d2b8700 1 -- 172.21.15.47:0/2490514544 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e84011a60 con 0x7f2e88107a20 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e9051e700 1 -- 172.21.15.47:0/2490514544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 msgr2=0x7f2e88107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e9051e700 1 --2- 172.21.15.47:0/2490514544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e88107e40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2e840098a0 tx=0x7f2e84009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e9051e700 1 -- 172.21.15.47:0/2490514544 shutdown_connections 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e9051e700 1 --2- 172.21.15.47:0/2490514544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e88107e40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e9051e700 1 -- 172.21.15.47:0/2490514544 >> 172.21.15.47:0/2490514544 conn(0x7f2e881018c0 msgr2=0x7f2e88103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:38.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e9051e700 1 -- 172.21.15.47:0/2490514544 shutdown_connections 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.729+0000 7f2e9051e700 1 -- 172.21.15.47:0/2490514544 wait complete. 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.730+0000 7f2e9051e700 1 Processor -- start 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.730+0000 7f2e9051e700 1 -- start start 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.730+0000 7f2e9051e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e8819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.730+0000 7f2e9051e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8810a8f0 con 0x7f2e88107a20 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.730+0000 7f2e8e2ba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e8819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.730+0000 7f2e8e2ba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e8819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60216/0 (socket says 172.21.15.47:60216) 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.730+0000 7f2e8e2ba700 1 -- 172.21.15.47:0/1969037047 learned_addr learned my addr 172.21.15.47:0/1969037047 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.731+0000 7f2e8e2ba700 1 -- 172.21.15.47:0/1969037047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8819a7a0 con 0x7f2e88107a20 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.731+0000 7f2e8e2ba700 1 --2- 172.21.15.47:0/1969037047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e8819a260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e84011700 tx=0x7f2e840046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.731+0000 7f2e7b7fe700 1 -- 172.21.15.47:0/1969037047 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e84003b20 con 0x7f2e88107a20 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.731+0000 7f2e7b7fe700 1 -- 172.21.15.47:0/1969037047 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f2e8401a8c0 con 0x7f2e88107a20 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.731+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8819aa30 con 0x7f2e88107a20 2024-04-06T03:28:38.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.731+0000 7f2e7b7fe700 1 -- 172.21.15.47:0/1969037047 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e840249a0 con 0x7f2e88107a20 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.731+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8819d720 con 0x7f2e88107a20 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.732+0000 7f2e7b7fe700 1 -- 172.21.15.47:0/1969037047 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 46069+0+0 (secure 0 0 0) 0x7f2e84022020 con 0x7f2e88107a20 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.732+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e88063900 con 0x7f2e88107a20 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.732+0000 7f2e7b7fe700 1 --2- 172.21.15.47:0/1969037047 >> v2:172.21.15.47:6800/2668596695 conn(0x7f2e74038d70 0x7f2e7403b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.732+0000 7f2e7b7fe700 1 -- 172.21.15.47:0/1969037047 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2e8404ceb0 con 0x7f2e88107a20 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.732+0000 7f2e8dab9700 1 --2- 172.21.15.47:0/1969037047 >> v2:172.21.15.47:6800/2668596695 conn(0x7f2e74038d70 0x7f2e7403b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.733+0000 7f2e8dab9700 1 --2- 172.21.15.47:0/1969037047 >> v2:172.21.15.47:6800/2668596695 conn(0x7f2e74038d70 0x7f2e7403b230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c006fd0 tx=0x7f2e7c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:37.737+0000 7f2e7b7fe700 1 -- 172.21.15.47:0/1969037047 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f2e8402d4a0 con 0x7f2e88107a20 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.023+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2e8819da90 con 0x7f2e88107a20 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.024+0000 7f2e7b7fe700 1 -- 172.21.15.47:0/1969037047 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f2e8400b5a0 con 0x7f2e88107a20 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 >> v2:172.21.15.47:6800/2668596695 conn(0x7f2e74038d70 msgr2=0x7f2e7403b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 --2- 172.21.15.47:0/1969037047 >> v2:172.21.15.47:6800/2668596695 conn(0x7f2e74038d70 0x7f2e7403b230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c006fd0 tx=0x7f2e7c006e40 comp rx=0 tx=0).stop 2024-04-06T03:28:38.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 msgr2=0x7f2e8819a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:38.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 --2- 172.21.15.47:0/1969037047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e8819a260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e84011700 tx=0x7f2e840046a0 comp rx=0 tx=0).stop 2024-04-06T03:28:38.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 shutdown_connections 2024-04-06T03:28:38.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 --2- 172.21.15.47:0/1969037047 >> v2:172.21.15.47:6800/2668596695 conn(0x7f2e74038d70 0x7f2e7403b230 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:38.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 --2- 172.21.15.47:0/1969037047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e88107a20 0x7f2e8819a260 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:38.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 >> 172.21.15.47:0/1969037047 conn(0x7f2e881018c0 msgr2=0x7f2e88102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:38.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 shutdown_connections 2024-04-06T03:28:38.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.026+0000 7f2e9051e700 1 -- 172.21.15.47:0/1969037047 wait complete. 2024-04-06T03:28:38.615 INFO:teuthology.orchestra.run.smithi047.stdout:mgr is available 2024-04-06T03:28:39.461 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/36749057' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-06T03:28:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-04-06T03:28:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-06T03:28:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-06T03:28:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-06T03:28:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-06T03:28:39.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.947+0000 7f1b66288700 1 Processor -- start 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.947+0000 7f1b66288700 1 -- start start 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b66288700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b60107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b66288700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b60108450 con 0x7f1b60107a60 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b5ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b60107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b5ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b60107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60220/0 (socket says 172.21.15.47:60220) 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b5ffff700 1 -- 172.21.15.47:0/1074383172 learned_addr learned my addr 172.21.15.47:0/1074383172 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b5ffff700 1 -- 172.21.15.47:0/1074383172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b601042b0 con 0x7f1b60107a60 2024-04-06T03:28:39.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b5ffff700 1 --2- 172.21.15.47:0/1074383172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b60107e80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b500098a0 tx=0x7f1b50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70df9c550da46b98 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b5effd700 1 -- 172.21.15.47:0/1074383172 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b50004160 con 0x7f1b60107a60 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b5effd700 1 -- 172.21.15.47:0/1074383172 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f1b50004300 con 0x7f1b60107a60 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.948+0000 7f1b5effd700 1 -- 172.21.15.47:0/1074383172 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b50011a60 con 0x7f1b60107a60 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.949+0000 7f1b66288700 1 -- 172.21.15.47:0/1074383172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 msgr2=0x7f1b60107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.949+0000 7f1b66288700 1 --2- 172.21.15.47:0/1074383172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b60107e80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b500098a0 tx=0x7f1b50009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.949+0000 7f1b66288700 1 -- 172.21.15.47:0/1074383172 shutdown_connections 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.949+0000 7f1b66288700 1 --2- 172.21.15.47:0/1074383172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b60107e80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.949+0000 7f1b66288700 1 -- 172.21.15.47:0/1074383172 >> 172.21.15.47:0/1074383172 conn(0x7f1b600ffff0 msgr2=0x7f1b60102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.949+0000 7f1b66288700 1 -- 172.21.15.47:0/1074383172 shutdown_connections 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.949+0000 7f1b66288700 1 -- 172.21.15.47:0/1074383172 wait complete. 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b66288700 1 Processor -- start 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b66288700 1 -- start start 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b66288700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b6019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b66288700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6010a800 con 0x7f1b60107a60 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b5ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b6019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b5ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b6019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60222/0 (socket says 172.21.15.47:60222) 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b5ffff700 1 -- 172.21.15.47:0/36749057 learned_addr learned my addr 172.21.15.47:0/36749057 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b5ffff700 1 -- 172.21.15.47:0/36749057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6019a7c0 con 0x7f1b60107a60 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.950+0000 7f1b5ffff700 1 --2- 172.21.15.47:0/36749057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b6019a280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b50011700 tx=0x7f1b500046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.951+0000 7f1b5d7fa700 1 -- 172.21.15.47:0/36749057 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b50003b20 con 0x7f1b60107a60 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.951+0000 7f1b5d7fa700 1 -- 172.21.15.47:0/36749057 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f1b5001a8c0 con 0x7f1b60107a60 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.951+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6019aa50 con 0x7f1b60107a60 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.951+0000 7f1b5d7fa700 1 -- 172.21.15.47:0/36749057 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b500249a0 con 0x7f1b60107a60 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.951+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6019d740 con 0x7f1b60107a60 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.951+0000 7f1b5d7fa700 1 -- 172.21.15.47:0/36749057 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 46069+0+0 (secure 0 0 0) 0x7f1b50022020 con 0x7f1b60107a60 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.952+0000 7f1b5d7fa700 1 --2- 172.21.15.47:0/36749057 >> v2:172.21.15.47:6800/2668596695 conn(0x7f1b4c038d70 0x7f1b4c03b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.952+0000 7f1b5d7fa700 1 -- 172.21.15.47:0/36749057 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1b5004cd40 con 0x7f1b60107a60 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.952+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b60063900 con 0x7f1b60107a60 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.952+0000 7f1b5f7fe700 1 --2- 172.21.15.47:0/36749057 >> v2:172.21.15.47:6800/2668596695 conn(0x7f1b4c038d70 0x7f1b4c03b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.952+0000 7f1b5f7fe700 1 --2- 172.21.15.47:0/36749057 >> v2:172.21.15.47:6800/2668596695 conn(0x7f1b4c038d70 0x7f1b4c03b230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1b48006fd0 tx=0x7f1b48006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:38.957+0000 7f1b5d7fa700 1 -- 172.21.15.47:0/36749057 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1b5002c3a0 con 0x7f1b60107a60 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.160+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f1b6019ea90 con 0x7f1b60107a60 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.161+0000 7f1b5d7fa700 1 -- 172.21.15.47:0/36749057 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+282 (secure 0 0 0) 0x7f1b50016260 con 0x7f1b60107a60 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.163+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 >> v2:172.21.15.47:6800/2668596695 conn(0x7f1b4c038d70 msgr2=0x7f1b4c03b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.163+0000 7f1b66288700 1 --2- 172.21.15.47:0/36749057 >> v2:172.21.15.47:6800/2668596695 conn(0x7f1b4c038d70 0x7f1b4c03b230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1b48006fd0 tx=0x7f1b48006e40 comp rx=0 tx=0).stop 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.163+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 msgr2=0x7f1b6019a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.163+0000 7f1b66288700 1 --2- 172.21.15.47:0/36749057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b6019a280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b50011700 tx=0x7f1b500046a0 comp rx=0 tx=0).stop 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.164+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 shutdown_connections 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.164+0000 7f1b66288700 1 --2- 172.21.15.47:0/36749057 >> v2:172.21.15.47:6800/2668596695 conn(0x7f1b4c038d70 0x7f1b4c03b230 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.164+0000 7f1b66288700 1 --2- 172.21.15.47:0/36749057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b60107a60 0x7f1b6019a280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.164+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 >> 172.21.15.47:0/36749057 conn(0x7f1b600ffff0 msgr2=0x7f1b60100a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.164+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 shutdown_connections 2024-04-06T03:28:39.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:39.164+0000 7f1b66288700 1 -- 172.21.15.47:0/36749057 wait complete. 2024-04-06T03:28:39.722 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling cephadm module... 2024-04-06T03:28:40.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2647282472' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-06T03:28:40.742 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ignoring --setuser ceph since I am not root 2024-04-06T03:28:40.742 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ignoring --setgroup ceph since I am not root 2024-04-06T03:28:41.040 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:41 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:41.021+0000 7fce98a62200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-06T03:28:41.047 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.131+0000 7f5e567c2700 1 Processor -- start 2024-04-06T03:28:41.047 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.131+0000 7f5e567c2700 1 -- start start 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.131+0000 7f5e567c2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e50109240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.131+0000 7f5e567c2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5e50079f20 con 0x7f5e50106e50 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.131+0000 7f5e4ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e50109240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.131+0000 7f5e4ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e50109240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60232/0 (socket says 172.21.15.47:60232) 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.131+0000 7f5e4ffff700 1 -- 172.21.15.47:0/442309903 learned_addr learned my addr 172.21.15.47:0/442309903 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.131+0000 7f5e4ffff700 1 -- 172.21.15.47:0/442309903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e50109780 con 0x7f5e50106e50 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e4ffff700 1 --2- 172.21.15.47:0/442309903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e50109240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e400098a0 tx=0x7f5e40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baeb3abe6711437d server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e4effd700 1 -- 172.21.15.47:0/442309903 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40004160 con 0x7f5e50106e50 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e4effd700 1 -- 172.21.15.47:0/442309903 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f5e40004300 con 0x7f5e50106e50 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e4effd700 1 -- 172.21.15.47:0/442309903 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40011a60 con 0x7f5e50106e50 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e567c2700 1 -- 172.21.15.47:0/442309903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 msgr2=0x7f5e50109240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:41.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e567c2700 1 --2- 172.21.15.47:0/442309903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e50109240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e400098a0 tx=0x7f5e40009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e567c2700 1 -- 172.21.15.47:0/442309903 shutdown_connections 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e567c2700 1 --2- 172.21.15.47:0/442309903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e50109240 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e567c2700 1 -- 172.21.15.47:0/442309903 >> 172.21.15.47:0/442309903 conn(0x7f5e50100820 msgr2=0x7f5e50102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e567c2700 1 -- 172.21.15.47:0/442309903 shutdown_connections 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.132+0000 7f5e567c2700 1 -- 172.21.15.47:0/442309903 wait complete. 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.133+0000 7f5e567c2700 1 Processor -- start 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.133+0000 7f5e567c2700 1 -- start start 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.133+0000 7f5e567c2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e5019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.133+0000 7f5e567c2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5010a670 con 0x7f5e50106e50 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.133+0000 7f5e4ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e5019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.133+0000 7f5e4ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e5019a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60234/0 (socket says 172.21.15.47:60234) 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.134+0000 7f5e4ffff700 1 -- 172.21.15.47:0/2647282472 learned_addr learned my addr 172.21.15.47:0/2647282472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.134+0000 7f5e4ffff700 1 -- 172.21.15.47:0/2647282472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5019a660 con 0x7f5e50106e50 2024-04-06T03:28:41.049 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.134+0000 7f5e4ffff700 1 --2- 172.21.15.47:0/2647282472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e5019a120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5e40011700 tx=0x7f5e40011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.134+0000 7f5e4d7fa700 1 -- 172.21.15.47:0/2647282472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4001a430 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.134+0000 7f5e4d7fa700 1 -- 172.21.15.47:0/2647282472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f5e4001aa60 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.134+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5019a8f0 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.134+0000 7f5e4d7fa700 1 -- 172.21.15.47:0/2647282472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40024970 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.134+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5019d5e0 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.135+0000 7f5e4d7fa700 1 -- 172.21.15.47:0/2647282472 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 46069+0+0 (secure 0 0 0) 0x7f5e40022020 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.135+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e50063900 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.135+0000 7f5e4d7fa700 1 --2- 172.21.15.47:0/2647282472 >> v2:172.21.15.47:6800/2668596695 conn(0x7f5e38038d70 0x7f5e3803b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.135+0000 7f5e4d7fa700 1 -- 172.21.15.47:0/2647282472 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5e4004d390 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.135+0000 7f5e4f7fe700 1 --2- 172.21.15.47:0/2647282472 >> v2:172.21.15.47:6800/2668596695 conn(0x7f5e38038d70 0x7f5e3803b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.136+0000 7f5e4f7fe700 1 --2- 172.21.15.47:0/2647282472 >> v2:172.21.15.47:6800/2668596695 conn(0x7f5e38038d70 0x7f5e3803b230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e44006fd0 tx=0x7f5e44006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.141+0000 7f5e4d7fa700 1 -- 172.21.15.47:0/2647282472 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5e4004d0f0 con 0x7f5e50106e50 2024-04-06T03:28:41.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.402+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f5e5019da40 con 0x7f5e50106e50 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.453+0000 7f5e4d7fa700 1 -- 172.21.15.47:0/2647282472 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f5e4002d3f0 con 0x7f5e50106e50 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.455+0000 7f5e4d7fa700 1 -- 172.21.15.47:0/2647282472 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mgrmap(e 5) ==== 46080+0+0 (secure 0 0 0) 0x7f5e40011d10 con 0x7f5e50106e50 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 >> v2:172.21.15.47:6800/2668596695 conn(0x7f5e38038d70 msgr2=0x7f5e3803b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 --2- 172.21.15.47:0/2647282472 >> v2:172.21.15.47:6800/2668596695 conn(0x7f5e38038d70 0x7f5e3803b230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e44006fd0 tx=0x7f5e44006e40 comp rx=0 tx=0).stop 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 msgr2=0x7f5e5019a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 --2- 172.21.15.47:0/2647282472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e5019a120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5e40011700 tx=0x7f5e40011b50 comp rx=0 tx=0).stop 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 shutdown_connections 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 --2- 172.21.15.47:0/2647282472 >> v2:172.21.15.47:6800/2668596695 conn(0x7f5e38038d70 0x7f5e3803b230 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 --2- 172.21.15.47:0/2647282472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e50106e50 0x7f5e5019a120 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 >> 172.21.15.47:0/2647282472 conn(0x7f5e50100820 msgr2=0x7f5e50101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 shutdown_connections 2024-04-06T03:28:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:40.456+0000 7f5e567c2700 1 -- 172.21.15.47:0/2647282472 wait complete. 2024-04-06T03:28:41.359 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:41 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:41.125+0000 7fce98a62200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-06T03:28:41.665 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2647282472' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-06T03:28:41.665 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:41 smithi047 ceph-mon[29365]: mgrmap e5: y(active, since 6s) 2024-04-06T03:28:41.991 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:41 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:41.795+0000 7fce98a62200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-06T03:28:41.992 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:41 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:41.890+0000 7fce98a62200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-06T03:28:42.346 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:42.034+0000 7fce98a62200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-06T03:28:42.346 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:42.133+0000 7fce98a62200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-06T03:28:42.347 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:42.218+0000 7fce98a62200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-06T03:28:42.355 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-04-06T03:28:42.355 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.459+0000 7f1267bc8700 1 Processor -- start 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.459+0000 7f1267bc8700 1 -- start start 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.459+0000 7f1267bc8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f1260106750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.459+0000 7f1267bc8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1260106d20 con 0x7f1260106330 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.460+0000 7f1265964700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f1260106750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.460+0000 7f1265964700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f1260106750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60260/0 (socket says 172.21.15.47:60260) 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.460+0000 7f1265964700 1 -- 172.21.15.47:0/3137278348 learned_addr learned my addr 172.21.15.47:0/3137278348 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.460+0000 7f1265964700 1 -- 172.21.15.47:0/3137278348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1260107530 con 0x7f1260106330 2024-04-06T03:28:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.460+0000 7f1265964700 1 --2- 172.21.15.47:0/3137278348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f1260106750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f125c0098a0 tx=0x7f125c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74d8718088e1455 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.460+0000 7f1264962700 1 -- 172.21.15.47:0/3137278348 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c004160 con 0x7f1260106330 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.460+0000 7f1264962700 1 -- 172.21.15.47:0/3137278348 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f125c004300 con 0x7f1260106330 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.460+0000 7f1264962700 1 -- 172.21.15.47:0/3137278348 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c011a60 con 0x7f1260106330 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.461+0000 7f1267bc8700 1 -- 172.21.15.47:0/3137278348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 msgr2=0x7f1260106750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.461+0000 7f1267bc8700 1 --2- 172.21.15.47:0/3137278348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f1260106750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f125c0098a0 tx=0x7f125c009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.461+0000 7f1267bc8700 1 -- 172.21.15.47:0/3137278348 shutdown_connections 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.461+0000 7f1267bc8700 1 --2- 172.21.15.47:0/3137278348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f1260106750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.461+0000 7f1267bc8700 1 -- 172.21.15.47:0/3137278348 >> 172.21.15.47:0/3137278348 conn(0x7f12601018f0 msgr2=0x7f1260103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.461+0000 7f1267bc8700 1 -- 172.21.15.47:0/3137278348 shutdown_connections 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.461+0000 7f1267bc8700 1 -- 172.21.15.47:0/3137278348 wait complete. 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.462+0000 7f1267bc8700 1 Processor -- start 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.462+0000 7f1267bc8700 1 -- start start 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.462+0000 7f1267bc8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f126019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.462+0000 7f1267bc8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f126010a760 con 0x7f1260106330 2024-04-06T03:28:42.357 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.462+0000 7f1265964700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f126019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.462+0000 7f1265964700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f126019a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60276/0 (socket says 172.21.15.47:60276) 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.462+0000 7f1265964700 1 -- 172.21.15.47:0/1956784956 learned_addr learned my addr 172.21.15.47:0/1956784956 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.463+0000 7f1265964700 1 -- 172.21.15.47:0/1956784956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126019a740 con 0x7f1260106330 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.463+0000 7f1265964700 1 --2- 172.21.15.47:0/1956784956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f126019a200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f125c011700 tx=0x7f125c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.463+0000 7f1256ffd700 1 -- 172.21.15.47:0/1956784956 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c0039e0 con 0x7f1260106330 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.463+0000 7f1256ffd700 1 -- 172.21.15.47:0/1956784956 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f125c01a8c0 con 0x7f1260106330 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.463+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126019a9d0 con 0x7f1260106330 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.463+0000 7f1256ffd700 1 -- 172.21.15.47:0/1956784956 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c024810 con 0x7f1260106330 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.463+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126019d6c0 con 0x7f1260106330 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.464+0000 7f1256ffd700 1 -- 172.21.15.47:0/1956784956 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 46080+0+0 (secure 0 0 0) 0x7f125c022020 con 0x7f1260106330 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.464+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126010a8e0 con 0x7f1260106330 2024-04-06T03:28:42.358 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.464+0000 7f1256ffd700 1 --2- 172.21.15.47:0/1956784956 >> v2:172.21.15.47:6800/2668596695 conn(0x7f124c038dc0 0x7f124c03b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:42.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.464+0000 7f1256ffd700 1 -- 172.21.15.47:0/1956784956 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f125c04cc60 con 0x7f1260106330 2024-04-06T03:28:42.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.464+0000 7f1265163700 1 -- 172.21.15.47:0/1956784956 >> v2:172.21.15.47:6800/2668596695 conn(0x7f124c038dc0 msgr2=0x7f124c03b280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2668596695 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.464+0000 7f1265163700 1 --2- 172.21.15.47:0/1956784956 >> v2:172.21.15.47:6800/2668596695 conn(0x7f124c038dc0 0x7f124c03b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.469+0000 7f1256ffd700 1 -- 172.21.15.47:0/1956784956 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f125c00b3e0 con 0x7f1260106330 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.665+0000 7f1265163700 1 -- 172.21.15.47:0/1956784956 >> v2:172.21.15.47:6800/2668596695 conn(0x7f124c038dc0 msgr2=0x7f124c03b280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2668596695 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.665+0000 7f1265163700 1 --2- 172.21.15.47:0/1956784956 >> v2:172.21.15.47:6800/2668596695 conn(0x7f124c038dc0 0x7f124c03b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.729+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f126019db00 con 0x7f1260106330 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.729+0000 7f1256ffd700 1 -- 172.21.15.47:0/1956784956 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f125c00fdd0 con 0x7f1260106330 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 >> v2:172.21.15.47:6800/2668596695 conn(0x7f124c038dc0 msgr2=0x7f124c03b280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 --2- 172.21.15.47:0/1956784956 >> v2:172.21.15.47:6800/2668596695 conn(0x7f124c038dc0 0x7f124c03b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 msgr2=0x7f126019a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 --2- 172.21.15.47:0/1956784956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f126019a200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f125c011700 tx=0x7f125c011ae0 comp rx=0 tx=0).stop 2024-04-06T03:28:42.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 shutdown_connections 2024-04-06T03:28:42.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 --2- 172.21.15.47:0/1956784956 >> v2:172.21.15.47:6800/2668596695 conn(0x7f124c038dc0 0x7f124c03b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:42.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 --2- 172.21.15.47:0/1956784956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1260106330 0x7f126019a200 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:42.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 >> 172.21.15.47:0/1956784956 conn(0x7f12601018f0 msgr2=0x7f12601023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:42.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 shutdown_connections 2024-04-06T03:28:42.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:41.731+0000 7f1267bc8700 1 -- 172.21.15.47:0/1956784956 wait complete. 2024-04-06T03:28:42.363 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-04-06T03:28:42.363 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 5... 2024-04-06T03:28:42.604 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1956784956' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-06T03:28:42.604 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:42.493+0000 7fce98a62200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-06T03:28:42.978 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:42.608+0000 7fce98a62200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-06T03:28:42.978 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:42.697+0000 7fce98a62200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-06T03:28:42.978 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:42.795+0000 7fce98a62200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-06T03:28:42.978 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:42 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:42.977+0000 7fce98a62200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-06T03:28:44.241 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:43.957+0000 7fce98a62200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-06T03:28:44.241 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:44 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:44.090+0000 7fce98a62200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-06T03:28:44.491 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:44 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:44.427+0000 7fce98a62200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-06T03:28:44.905 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:44 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:44.518+0000 7fce98a62200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-06T03:28:44.906 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:44 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:44.717+0000 7fce98a62200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:28:44.906 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:44 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:44.905+0000 7fce98a62200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-06T03:28:45.454 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:45 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:45.193+0000 7fce98a62200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:28:45.454 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:45 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:45.453+0000 7fce98a62200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-06T03:28:45.741 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:45 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:45.695+0000 7fce98a62200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-06T03:28:46.991 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:46 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:46.517+0000 7fce98a62200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-06T03:28:47.417 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:47.097+0000 7fce98a62200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-06T03:28:47.417 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:47.197+0000 7fce98a62200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-06T03:28:47.417 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:28:47.417+0000 7fce98a62200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: Active manager daemon y restarted 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: Activating manager daemon y 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: osdmap e2: 0 total, 0 up, 0 in 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: mgrmap e6: y(active, starting, since 0.00337772s) 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: Manager daemon y is now available 2024-04-06T03:28:47.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:28:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:28:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:28:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:47 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:28:48.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:48 smithi047 ceph-mon[29365]: Found migration_current of "None". Setting to last migration. 2024-04-06T03:28:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:48 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-06T03:28:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:48 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-06T03:28:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:48 smithi047 ceph-mon[29365]: mgrmap e7: y(active, since 1.00554s) 2024-04-06T03:28:48.996 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-04-06T03:28:48.996 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-06T03:28:48.996 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-06T03:28:48.996 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-04-06T03:28:48.996 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.834+0000 7fa9aa960700 1 Processor -- start 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.834+0000 7fa9aa960700 1 -- start start 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.834+0000 7fa9aa960700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a4106d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.834+0000 7fa9aa960700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a4104e70 con 0x7fa9a4106930 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.834+0000 7fa9a3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a4106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.834+0000 7fa9a3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a4106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60286/0 (socket says 172.21.15.47:60286) 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.834+0000 7fa9a3fff700 1 -- 172.21.15.47:0/1577919106 learned_addr learned my addr 172.21.15.47:0/1577919106 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.835+0000 7fa9a3fff700 1 -- 172.21.15.47:0/1577919106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a4104ff0 con 0x7fa9a4106930 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.835+0000 7fa9a3fff700 1 --2- 172.21.15.47:0/1577919106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a4106d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9940098a0 tx=0x7fa994009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6470b2a6b5a079 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.835+0000 7fa9a2ffd700 1 -- 172.21.15.47:0/1577919106 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994004160 con 0x7fa9a4106930 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.835+0000 7fa9a2ffd700 1 -- 172.21.15.47:0/1577919106 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fa994004300 con 0x7fa9a4106930 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.835+0000 7fa9a2ffd700 1 -- 172.21.15.47:0/1577919106 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994011a60 con 0x7fa9a4106930 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 -- 172.21.15.47:0/1577919106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 msgr2=0x7fa9a4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 --2- 172.21.15.47:0/1577919106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a4106d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9940098a0 tx=0x7fa994009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 -- 172.21.15.47:0/1577919106 shutdown_connections 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 --2- 172.21.15.47:0/1577919106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a4106d50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 -- 172.21.15.47:0/1577919106 >> 172.21.15.47:0/1577919106 conn(0x7fa9a4100870 msgr2=0x7fa9a4102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 -- 172.21.15.47:0/1577919106 shutdown_connections 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 -- 172.21.15.47:0/1577919106 wait complete. 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 Processor -- start 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.836+0000 7fa9aa960700 1 -- start start 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9aa960700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9aa960700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a4109800 con 0x7fa9a4106930 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9a3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9a3fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a419a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60288/0 (socket says 172.21.15.47:60288) 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9a3fff700 1 -- 172.21.15.47:0/4194458311 learned_addr learned my addr 172.21.15.47:0/4194458311 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:48.998 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9a3fff700 1 -- 172.21.15.47:0/4194458311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a419a800 con 0x7fa9a4106930 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9a3fff700 1 --2- 172.21.15.47:0/4194458311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a419a2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa994011700 tx=0x7fa9940046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994003b20 con 0x7fa9a4106930 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fa99401a8c0 con 0x7fa9a4106930 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a419aa90 con 0x7fa9a4106930 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9940249a0 con 0x7fa9a4106930 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.837+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a419d780 con 0x7fa9a4106930 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.838+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 46080+0+0 (secure 0 0 0) 0x7fa994022020 con 0x7fa9a4106930 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.838+0000 7fa9a17fa700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 0x7fa98c03b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.838+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 --> v2:172.21.15.47:6800/2668596695 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa98c03b900 con 0x7fa98c038d70 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.838+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa99404d170 con 0x7fa9a4106930 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.838+0000 7fa9a37fe700 1 -- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 msgr2=0x7fa98c03b230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2668596695 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:42.838+0000 7fa9a37fe700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 0x7fa98c03b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:43.039+0000 7fa9a37fe700 1 -- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 msgr2=0x7fa98c03b230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2668596695 2024-04-06T03:28:48.999 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:43.039+0000 7fa9a37fe700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 0x7fa98c03b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:43.440+0000 7fa9a37fe700 1 -- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 msgr2=0x7fa98c03b230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2668596695 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:43.440+0000 7fa9a37fe700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 0x7fa98c03b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:44.241+0000 7fa9a37fe700 1 -- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 msgr2=0x7fa98c03b230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2668596695 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:44.241+0000 7fa9a37fe700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 0x7fa98c03b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:45.842+0000 7fa9a37fe700 1 -- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 msgr2=0x7fa98c03b230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/2668596695 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:45.842+0000 7fa9a37fe700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 0x7fa98c03b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:47.432+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mgrmap(e 6) ==== 45882+0+0 (secure 0 0 0) 0x7fa99402d3f0 con 0x7fa9a4106930 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:47.432+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 msgr2=0x7fa98c03b230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:47.432+0000 7fa9a17fa700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 0x7fa98c03b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:49.000 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.433+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 7) ==== 45974+0+0 (secure 0 0 0) 0x7fa99404ee90 con 0x7fa9a4106930 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.434+0000 7fa9a17fa700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa98c03c6d0 0x7fa98c03eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.434+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 --> v2:172.21.15.47:6800/4248661693 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa99400be50 con 0x7fa98c03c6d0 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.434+0000 7fa9a37fe700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa98c03c6d0 0x7fa98c03eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.435+0000 7fa9a37fe700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa98c03c6d0 0x7fa98c03eac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa998003a10 tx=0x7fa998009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.435+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mgr.14120 v2:172.21.15.47:6800/4248661693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7fa99400be50 con 0x7fa98c03c6d0 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.447+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 --> v2:172.21.15.47:6800/4248661693 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa9a4063900 con 0x7fa98c03c6d0 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.447+0000 7fa9a17fa700 1 -- 172.21.15.47:0/4194458311 <== mgr.14120 v2:172.21.15.47:6800/4248661693 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa9a4063900 con 0x7fa98c03c6d0 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.447+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa98c03c6d0 msgr2=0x7fa98c03eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.447+0000 7fa9aa960700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa98c03c6d0 0x7fa98c03eac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa998003a10 tx=0x7fa998009290 comp rx=0 tx=0).stop 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.447+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 msgr2=0x7fa9a419a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.447+0000 7fa9aa960700 1 --2- 172.21.15.47:0/4194458311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a419a2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa994011700 tx=0x7fa9940046a0 comp rx=0 tx=0).stop 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.448+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 shutdown_connections 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.448+0000 7fa9aa960700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa98c03c6d0 0x7fa98c03eac0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.448+0000 7fa9aa960700 1 --2- 172.21.15.47:0/4194458311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a4106930 0x7fa9a419a2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:49.002 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.448+0000 7fa9aa960700 1 --2- 172.21.15.47:0/4194458311 >> v2:172.21.15.47:6800/2668596695 conn(0x7fa98c038d70 0x7fa98c03b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:49.002 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.448+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 >> 172.21.15.47:0/4194458311 conn(0x7fa9a4100870 msgr2=0x7fa9a4190e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:49.002 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.448+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 shutdown_connections 2024-04-06T03:28:49.002 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:48.448+0000 7fa9aa960700 1 -- 172.21.15.47:0/4194458311 wait complete. 2024-04-06T03:28:49.002 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 5 is available 2024-04-06T03:28:49.002 INFO:teuthology.orchestra.run.smithi047.stdout:Setting orchestrator backend to cephadm... 2024-04-06T03:28:49.669 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:49 smithi047 ceph-mon[29365]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-06T03:28:49.669 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:49 smithi047 ceph-mon[29365]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-06T03:28:49.669 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:49 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:28:49.669 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:49 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:28:50.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.438+0000 7f993979c700 1 Processor -- start 2024-04-06T03:28:50.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.439+0000 7f993979c700 1 -- start start 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.439+0000 7f993979c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f9934106720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.439+0000 7f993979c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9934106cf0 con 0x7f9934106300 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.439+0000 7f9932ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f9934106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.439+0000 7f9932ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f9934106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48486/0 (socket says 172.21.15.47:48486) 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.439+0000 7f9932ffd700 1 -- 172.21.15.47:0/3338048555 learned_addr learned my addr 172.21.15.47:0/3338048555 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.439+0000 7f9932ffd700 1 -- 172.21.15.47:0/3338048555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9934107500 con 0x7f9934106300 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.439+0000 7f9932ffd700 1 --2- 172.21.15.47:0/3338048555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f9934106720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99240098a0 tx=0x7f9924009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4933c944a8f78cfc server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f9931ffb700 1 -- 172.21.15.47:0/3338048555 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9924004160 con 0x7f9934106300 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f9931ffb700 1 -- 172.21.15.47:0/3338048555 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f9924004300 con 0x7f9934106300 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f9931ffb700 1 -- 172.21.15.47:0/3338048555 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9924011a60 con 0x7f9934106300 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f993979c700 1 -- 172.21.15.47:0/3338048555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 msgr2=0x7f9934106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f993979c700 1 --2- 172.21.15.47:0/3338048555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f9934106720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99240098a0 tx=0x7f9924009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f993979c700 1 -- 172.21.15.47:0/3338048555 shutdown_connections 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f993979c700 1 --2- 172.21.15.47:0/3338048555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f9934106720 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:50.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f993979c700 1 -- 172.21.15.47:0/3338048555 >> 172.21.15.47:0/3338048555 conn(0x7f99341018c0 msgr2=0x7f9934103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f993979c700 1 -- 172.21.15.47:0/3338048555 shutdown_connections 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.440+0000 7f993979c700 1 -- 172.21.15.47:0/3338048555 wait complete. 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.441+0000 7f993979c700 1 Processor -- start 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.441+0000 7f993979c700 1 -- start start 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.441+0000 7f993979c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f993419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.441+0000 7f993979c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f993410a730 con 0x7f9934106300 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.441+0000 7f9932ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f993419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.441+0000 7f9932ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f993419a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48502/0 (socket says 172.21.15.47:48502) 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.441+0000 7f9932ffd700 1 -- 172.21.15.47:0/1270841212 learned_addr learned my addr 172.21.15.47:0/1270841212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.442+0000 7f9932ffd700 1 -- 172.21.15.47:0/1270841212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993419a6b0 con 0x7f9934106300 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.442+0000 7f9932ffd700 1 --2- 172.21.15.47:0/1270841212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f993419a170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9924009fb0 tx=0x7f99240046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.442+0000 7f992bfff700 1 -- 172.21.15.47:0/1270841212 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992401a430 con 0x7f9934106300 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.442+0000 7f992bfff700 1 -- 172.21.15.47:0/1270841212 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f992401aa60 con 0x7f9934106300 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.442+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993419a940 con 0x7f9934106300 2024-04-06T03:28:50.226 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.442+0000 7f992bfff700 1 -- 172.21.15.47:0/1270841212 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99240249b0 con 0x7f9934106300 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.442+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993419d630 con 0x7f9934106300 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.443+0000 7f992bfff700 1 -- 172.21.15.47:0/1270841212 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 45974+0+0 (secure 0 0 0) 0x7f9924022020 con 0x7f9934106300 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.443+0000 7f992bfff700 1 --2- 172.21.15.47:0/1270841212 >> v2:172.21.15.47:6800/4248661693 conn(0x7f9920038ca0 0x7f992003b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.443+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f993410a8b0 con 0x7f9934106300 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.443+0000 7f992bfff700 1 -- 172.21.15.47:0/1270841212 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f992404d2e0 con 0x7f9934106300 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.443+0000 7f99327fc700 1 --2- 172.21.15.47:0/1270841212 >> v2:172.21.15.47:6800/4248661693 conn(0x7f9920038ca0 0x7f992003b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.443+0000 7f99327fc700 1 --2- 172.21.15.47:0/1270841212 >> v2:172.21.15.47:6800/4248661693 conn(0x7f9920038ca0 0x7f992003b160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f991c006fd0 tx=0x7f991c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.448+0000 7f992bfff700 1 -- 172.21.15.47:0/1270841212 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f992400b3e0 con 0x7f9934106300 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.550+0000 7f992bfff700 1 -- 172.21.15.47:0/1270841212 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7f9924011d10 con 0x7f9934106300 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.669+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 --> v2:172.21.15.47:6800/4248661693 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f9934102a40 con 0x7f9920038ca0 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.674+0000 7f992bfff700 1 -- 172.21.15.47:0/1270841212 <== mgr.14120 v2:172.21.15.47:6800/4248661693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9934102a40 con 0x7f9920038ca0 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.676+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 >> v2:172.21.15.47:6800/4248661693 conn(0x7f9920038ca0 msgr2=0x7f992003b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.676+0000 7f993979c700 1 --2- 172.21.15.47:0/1270841212 >> v2:172.21.15.47:6800/4248661693 conn(0x7f9920038ca0 0x7f992003b160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f991c006fd0 tx=0x7f991c006e40 comp rx=0 tx=0).stop 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.676+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 msgr2=0x7f993419a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.676+0000 7f993979c700 1 --2- 172.21.15.47:0/1270841212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f993419a170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9924009fb0 tx=0x7f99240046a0 comp rx=0 tx=0).stop 2024-04-06T03:28:50.227 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.677+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 shutdown_connections 2024-04-06T03:28:50.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.677+0000 7f993979c700 1 --2- 172.21.15.47:0/1270841212 >> v2:172.21.15.47:6800/4248661693 conn(0x7f9920038ca0 0x7f992003b160 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:50.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.677+0000 7f993979c700 1 --2- 172.21.15.47:0/1270841212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9934106300 0x7f993419a170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:50.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.677+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 >> 172.21.15.47:0/1270841212 conn(0x7f99341018c0 msgr2=0x7f9934102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:50.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.677+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 shutdown_connections 2024-04-06T03:28:50.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:49.677+0000 7f993979c700 1 -- 172.21.15.47:0/1270841212 wait complete. 2024-04-06T03:28:50.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:50 smithi047 ceph-mon[29365]: mgrmap e8: y(active, since 2s) 2024-04-06T03:28:50.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:50 smithi047 ceph-mon[29365]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:28:50.596 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:50 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:28:50.596 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:50 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:28:50.596 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:50 smithi047 ceph-mon[29365]: [06/Apr/2024:03:28:50] ENGINE Bus STARTING 2024-04-06T03:28:51.440 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-06T03:28:51.440 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.604+0000 7f08865c9700 1 Processor -- start 2024-04-06T03:28:51.440 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.604+0000 7f08865c9700 1 -- start start 2024-04-06T03:28:51.440 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f08865c9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f0880106750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:51.440 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f08865c9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0880106d20 con 0x7f0880106330 2024-04-06T03:28:51.440 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f087ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f0880106750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f087ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f0880106750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48504/0 (socket says 172.21.15.47:48504) 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f087ffff700 1 -- 172.21.15.47:0/850003274 learned_addr learned my addr 172.21.15.47:0/850003274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f087ffff700 1 -- 172.21.15.47:0/850003274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0880107530 con 0x7f0880106330 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f087ffff700 1 --2- 172.21.15.47:0/850003274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f0880106750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08700098a0 tx=0x7f0870009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf904016d0aab8d server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f087effd700 1 -- 172.21.15.47:0/850003274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870004160 con 0x7f0880106330 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.605+0000 7f087effd700 1 -- 172.21.15.47:0/850003274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f0870004300 con 0x7f0880106330 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.606+0000 7f087effd700 1 -- 172.21.15.47:0/850003274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870011a60 con 0x7f0880106330 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.606+0000 7f08865c9700 1 -- 172.21.15.47:0/850003274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 msgr2=0x7f0880106750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.606+0000 7f08865c9700 1 --2- 172.21.15.47:0/850003274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f0880106750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08700098a0 tx=0x7f0870009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.606+0000 7f08865c9700 1 -- 172.21.15.47:0/850003274 shutdown_connections 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.606+0000 7f08865c9700 1 --2- 172.21.15.47:0/850003274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f0880106750 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.606+0000 7f08865c9700 1 -- 172.21.15.47:0/850003274 >> 172.21.15.47:0/850003274 conn(0x7f08801018f0 msgr2=0x7f0880103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.606+0000 7f08865c9700 1 -- 172.21.15.47:0/850003274 shutdown_connections 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.606+0000 7f08865c9700 1 -- 172.21.15.47:0/850003274 wait complete. 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.607+0000 7f08865c9700 1 Processor -- start 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.607+0000 7f08865c9700 1 -- start start 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.607+0000 7f08865c9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f088019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.607+0000 7f08865c9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f088010a760 con 0x7f0880106330 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.607+0000 7f087ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f088019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.607+0000 7f087ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f088019a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48514/0 (socket says 172.21.15.47:48514) 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.607+0000 7f087ffff700 1 -- 172.21.15.47:0/443224446 learned_addr learned my addr 172.21.15.47:0/443224446 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.607+0000 7f087ffff700 1 -- 172.21.15.47:0/443224446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088019a740 con 0x7f0880106330 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.608+0000 7f087ffff700 1 --2- 172.21.15.47:0/443224446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f088019a200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0870009fb0 tx=0x7f0870011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.608+0000 7f087d7fa700 1 -- 172.21.15.47:0/443224446 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08700039e0 con 0x7f0880106330 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.608+0000 7f087d7fa700 1 -- 172.21.15.47:0/443224446 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f087001a8c0 con 0x7f0880106330 2024-04-06T03:28:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.608+0000 7f087d7fa700 1 -- 172.21.15.47:0/443224446 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870024800 con 0x7f0880106330 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.608+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088019a9d0 con 0x7f0880106330 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.608+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088019d6c0 con 0x7f0880106330 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.609+0000 7f087d7fa700 1 -- 172.21.15.47:0/443224446 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7f0870022020 con 0x7f0880106330 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.609+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088010a8e0 con 0x7f0880106330 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.609+0000 7f087d7fa700 1 --2- 172.21.15.47:0/443224446 >> v2:172.21.15.47:6800/4248661693 conn(0x7f0868038e00 0x7f086803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.609+0000 7f087d7fa700 1 -- 172.21.15.47:0/443224446 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f087004cd30 con 0x7f0880106330 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.609+0000 7f087f7fe700 1 --2- 172.21.15.47:0/443224446 >> v2:172.21.15.47:6800/4248661693 conn(0x7f0868038e00 0x7f086803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.609+0000 7f087f7fe700 1 --2- 172.21.15.47:0/443224446 >> v2:172.21.15.47:6800/4248661693 conn(0x7f0868038e00 0x7f086803b2c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0874006fd0 tx=0x7f0874006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.614+0000 7f087d7fa700 1 -- 172.21.15.47:0/443224446 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f087000be50 con 0x7f0880106330 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.821+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 --> v2:172.21.15.47:6800/4248661693 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f0880102ac0 con 0x7f0868038e00 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.822+0000 7f087d7fa700 1 -- 172.21.15.47:0/443224446 <== mgr.14120 v2:172.21.15.47:6800/4248661693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f0880102ac0 con 0x7f0868038e00 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 >> v2:172.21.15.47:6800/4248661693 conn(0x7f0868038e00 msgr2=0x7f086803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 --2- 172.21.15.47:0/443224446 >> v2:172.21.15.47:6800/4248661693 conn(0x7f0868038e00 0x7f086803b2c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0874006fd0 tx=0x7f0874006e40 comp rx=0 tx=0).stop 2024-04-06T03:28:51.443 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 msgr2=0x7f088019a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:51.444 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 --2- 172.21.15.47:0/443224446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f088019a200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0870009fb0 tx=0x7f0870011ae0 comp rx=0 tx=0).stop 2024-04-06T03:28:51.444 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 shutdown_connections 2024-04-06T03:28:51.444 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 --2- 172.21.15.47:0/443224446 >> v2:172.21.15.47:6800/4248661693 conn(0x7f0868038e00 0x7f086803b2c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:51.444 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 --2- 172.21.15.47:0/443224446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0880106330 0x7f088019a200 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:51.444 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 >> 172.21.15.47:0/443224446 conn(0x7f08801018f0 msgr2=0x7f08801023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:51.444 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 shutdown_connections 2024-04-06T03:28:51.444 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:50.824+0000 7f08865c9700 1 -- 172.21.15.47:0/443224446 wait complete. 2024-04-06T03:28:51.444 INFO:teuthology.orchestra.run.smithi047.stdout:Generating ssh key... 2024-04-06T03:28:51.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:51 smithi047 ceph-mon[29365]: [06/Apr/2024:03:28:50] ENGINE Serving on http://172.21.15.47:8765 2024-04-06T03:28:51.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:51 smithi047 ceph-mon[29365]: [06/Apr/2024:03:28:50] ENGINE Serving on https://172.21.15.47:7150 2024-04-06T03:28:51.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:51 smithi047 ceph-mon[29365]: [06/Apr/2024:03:28:50] ENGINE Bus STARTED 2024-04-06T03:28:51.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:51 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:28:51.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:51 smithi047 ceph-mon[29365]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:28:52.339 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: Generating public/private rsa key pair. 2024-04-06T03:28:52.339 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: Your identification has been saved in /tmp/tmpu4mv63ic/key. 2024-04-06T03:28:52.339 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: Your public key has been saved in /tmp/tmpu4mv63ic/key.pub. 2024-04-06T03:28:52.339 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: The key fingerprint is: 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: SHA256:wG9iMWHc7LqjrJW1bpgs9IlytTIZo67r7IXca80StxI ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: The key's randomart image is: 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: +---[RSA 3072]----+ 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: | .oo | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: | o..o | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: | =. | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: | =. | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: | +.S | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: |. *E.=.+ | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: | = @O=o. | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: |+ O*O=+ | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: |BOo*=o.. | 2024-04-06T03:28:52.340 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:28:52 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: +----[SHA256]-----+ 2024-04-06T03:28:52.921 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.872+0000 7f50f8ec0700 1 Processor -- start 2024-04-06T03:28:52.921 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.872+0000 7f50f8ec0700 1 -- start start 2024-04-06T03:28:52.921 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.872+0000 7f50f8ec0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f4106d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.872+0000 7f50f8ec0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50f4104e70 con 0x7f50f4106930 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.873+0000 7f50f259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f4106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.873+0000 7f50f259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f4106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48530/0 (socket says 172.21.15.47:48530) 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.873+0000 7f50f259c700 1 -- 172.21.15.47:0/2093848703 learned_addr learned my addr 172.21.15.47:0/2093848703 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.873+0000 7f50f259c700 1 -- 172.21.15.47:0/2093848703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f4104ff0 con 0x7f50f4106930 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.873+0000 7f50f259c700 1 --2- 172.21.15.47:0/2093848703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f4106d50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50e400bb40 tx=0x7f50e400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92dc01290865bb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.873+0000 7f50f159a700 1 -- 172.21.15.47:0/2093848703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e400dbe0 con 0x7f50f4106930 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.873+0000 7f50f159a700 1 -- 172.21.15.47:0/2093848703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f50e40044c0 con 0x7f50f4106930 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.873+0000 7f50f159a700 1 -- 172.21.15.47:0/2093848703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e4010470 con 0x7f50f4106930 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.874+0000 7f50f8ec0700 1 -- 172.21.15.47:0/2093848703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 msgr2=0x7f50f4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.874+0000 7f50f8ec0700 1 --2- 172.21.15.47:0/2093848703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f4106d50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50e400bb40 tx=0x7f50e400be50 comp rx=0 tx=0).stop 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.874+0000 7f50f8ec0700 1 -- 172.21.15.47:0/2093848703 shutdown_connections 2024-04-06T03:28:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.874+0000 7f50f8ec0700 1 --2- 172.21.15.47:0/2093848703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f4106d50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.874+0000 7f50f8ec0700 1 -- 172.21.15.47:0/2093848703 >> 172.21.15.47:0/2093848703 conn(0x7f50f4100870 msgr2=0x7f50f4102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.874+0000 7f50f8ec0700 1 -- 172.21.15.47:0/2093848703 shutdown_connections 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.874+0000 7f50f8ec0700 1 -- 172.21.15.47:0/2093848703 wait complete. 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.875+0000 7f50f8ec0700 1 Processor -- start 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.875+0000 7f50f8ec0700 1 -- start start 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.875+0000 7f50f8ec0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f41980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.875+0000 7f50f8ec0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50f40789d0 con 0x7f50f4106930 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.875+0000 7f50f259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f41980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.875+0000 7f50f259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f41980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48544/0 (socket says 172.21.15.47:48544) 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.875+0000 7f50f259c700 1 -- 172.21.15.47:0/744654542 learned_addr learned my addr 172.21.15.47:0/744654542 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.876+0000 7f50f259c700 1 -- 172.21.15.47:0/744654542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f4198630 con 0x7f50f4106930 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.876+0000 7f50f259c700 1 --2- 172.21.15.47:0/744654542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f41980f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f50e400bfd0 tx=0x7f50e4003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.876+0000 7f50e37fe700 1 -- 172.21.15.47:0/744654542 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e4027070 con 0x7f50f4106930 2024-04-06T03:28:52.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.876+0000 7f50e37fe700 1 -- 172.21.15.47:0/744654542 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f50e4010c00 con 0x7f50f4106930 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.876+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f41988c0 con 0x7f50f4106930 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.876+0000 7f50e37fe700 1 -- 172.21.15.47:0/744654542 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e4022b90 con 0x7f50f4106930 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.876+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f419b5b0 con 0x7f50f4106930 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.877+0000 7f50e37fe700 1 -- 172.21.15.47:0/744654542 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7f50e402a070 con 0x7f50f4106930 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.877+0000 7f50e37fe700 1 --2- 172.21.15.47:0/744654542 >> v2:172.21.15.47:6800/4248661693 conn(0x7f50dc038d70 0x7f50dc03b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.877+0000 7f50e37fe700 1 -- 172.21.15.47:0/744654542 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f50e401f070 con 0x7f50f4106930 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.877+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f4063900 con 0x7f50f4106930 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.877+0000 7f50f1d9b700 1 --2- 172.21.15.47:0/744654542 >> v2:172.21.15.47:6800/4248661693 conn(0x7f50dc038d70 0x7f50dc03b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.877+0000 7f50f1d9b700 1 --2- 172.21.15.47:0/744654542 >> v2:172.21.15.47:6800/4248661693 conn(0x7f50dc038d70 0x7f50dc03b230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f50e8006fd0 tx=0x7f50e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:51.882+0000 7f50e37fe700 1 -- 172.21.15.47:0/744654542 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f50e4015070 con 0x7f50f4106930 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.087+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 --> v2:172.21.15.47:6800/4248661693 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f50f4062710 con 0x7f50dc038d70 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.336+0000 7f50e37fe700 1 -- 172.21.15.47:0/744654542 <== mgr.14120 v2:172.21.15.47:6800/4248661693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f50f4062710 con 0x7f50dc038d70 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 >> v2:172.21.15.47:6800/4248661693 conn(0x7f50dc038d70 msgr2=0x7f50dc03b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:52.924 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 --2- 172.21.15.47:0/744654542 >> v2:172.21.15.47:6800/4248661693 conn(0x7f50dc038d70 0x7f50dc03b230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f50e8006fd0 tx=0x7f50e8006e40 comp rx=0 tx=0).stop 2024-04-06T03:28:52.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 msgr2=0x7f50f41980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:52.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 --2- 172.21.15.47:0/744654542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f41980f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f50e400bfd0 tx=0x7f50e4003f00 comp rx=0 tx=0).stop 2024-04-06T03:28:52.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 shutdown_connections 2024-04-06T03:28:52.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 --2- 172.21.15.47:0/744654542 >> v2:172.21.15.47:6800/4248661693 conn(0x7f50dc038d70 0x7f50dc03b230 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:52.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 --2- 172.21.15.47:0/744654542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f4106930 0x7f50f41980f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:52.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 >> 172.21.15.47:0/744654542 conn(0x7f50f4100870 msgr2=0x7f50f418e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:52.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 shutdown_connections 2024-04-06T03:28:52.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:52.338+0000 7f50f8ec0700 1 -- 172.21.15.47:0/744654542 wait complete. 2024-04-06T03:28:53.491 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:53 smithi047 ceph-mon[29365]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:28:53.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:53 smithi047 ceph-mon[29365]: Generating ssh key... 2024-04-06T03:28:53.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:53 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:28:53.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:53 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:28:54.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDz6U2tH3PxCkHxixCqZQCH8qRw0+wDm0/nSB9TW9M0Xss2T0d+2qUPZXNPcJmOVtM7bl4oLIwgbbwJt+nsOfFhT2EZAUZp2ygEYaoy8GxOU6csI4L9vHZzujqhq7Lvs2jjOw8q+ujmVl58NGAzf4kXqbnFWslyw3CtO7ojlgbOyBznpAgpxl41iO77uz3RtgcW8uy04vBEjyUZwdIV46Pq7i71uNmrqpAJ1YxsadmXMmuOdH1oCOE+c6/WVOMr96qWSsQqIuKLoskv+wDrJqg6xzk8Yh735uwcgMTPnOfXySB/PqsKpi28rSh7G+B2C8ww6ANUL1bLNn2mxYrKs9v+t5/7TYUgmU7ootojX/lFPY4Hd3ORoRq6bn1tFSvLgwdTxcavIMcKMK6Ff+mVDX3xKBIHpyi3ohtqPeRdW+M/Pom9IRB+miBSsblpN1ydRSYU1JXKWETiD33V4TcOh1F45aHJ4uDaEssDyts/SCz20Zwl6E+8h1qU1ZlcCO814dk= ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:28:54.186 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.350+0000 7f1ecbe41700 1 Processor -- start 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.350+0000 7f1ecbe41700 1 -- start start 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ecbe41700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec4105050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ecbe41700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec40797b0 con 0x7f1ec4104c30 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ec9bdd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec4105050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ec9bdd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec4105050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48558/0 (socket says 172.21.15.47:48558) 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ec9bdd700 1 -- 172.21.15.47:0/3757009020 learned_addr learned my addr 172.21.15.47:0/3757009020 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ec9bdd700 1 -- 172.21.15.47:0/3757009020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec4105590 con 0x7f1ec4104c30 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ec9bdd700 1 --2- 172.21.15.47:0/3757009020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec4105050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009e80 tx=0x7f1eb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf93669dce2b975 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ec8bdb700 1 -- 172.21.15.47:0/3757009020 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb4017070 con 0x7f1ec4104c30 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ec8bdb700 1 -- 172.21.15.47:0/3757009020 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f1eb400b8c0 con 0x7f1ec4104c30 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.351+0000 7f1ec8bdb700 1 -- 172.21.15.47:0/3757009020 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb4004470 con 0x7f1ec4104c30 2024-04-06T03:28:54.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.352+0000 7f1ecbe41700 1 -- 172.21.15.47:0/3757009020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 msgr2=0x7f1ec4105050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.352+0000 7f1ecbe41700 1 --2- 172.21.15.47:0/3757009020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec4105050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009e80 tx=0x7f1eb400b330 comp rx=0 tx=0).stop 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.352+0000 7f1ecbe41700 1 -- 172.21.15.47:0/3757009020 shutdown_connections 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.352+0000 7f1ecbe41700 1 --2- 172.21.15.47:0/3757009020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec4105050 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.352+0000 7f1ecbe41700 1 -- 172.21.15.47:0/3757009020 >> 172.21.15.47:0/3757009020 conn(0x7f1ec4100870 msgr2=0x7f1ec4102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.352+0000 7f1ecbe41700 1 -- 172.21.15.47:0/3757009020 shutdown_connections 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.352+0000 7f1ecbe41700 1 -- 172.21.15.47:0/3757009020 wait complete. 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ecbe41700 1 Processor -- start 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ecbe41700 1 -- start start 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ecbe41700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ecbe41700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec4106550 con 0x7f1ec4104c30 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ec9bdd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:54.188 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ec9bdd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec419c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48560/0 (socket says 172.21.15.47:48560) 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ec9bdd700 1 -- 172.21.15.47:0/1578588369 learned_addr learned my addr 172.21.15.47:0/1578588369 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ec9bdd700 1 -- 172.21.15.47:0/1578588369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec419c9d0 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.353+0000 7f1ec9bdd700 1 --2- 172.21.15.47:0/1578588369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec419c490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40072a0 tx=0x7f1eb4009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.354+0000 7f1ec2ffd700 1 -- 172.21.15.47:0/1578588369 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb4021020 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.354+0000 7f1ec2ffd700 1 -- 172.21.15.47:0/1578588369 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f1eb4003d40 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.354+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec419cc60 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.354+0000 7f1ec2ffd700 1 -- 172.21.15.47:0/1578588369 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb4017040 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.354+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec419f950 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.354+0000 7f1ec2ffd700 1 -- 172.21.15.47:0/1578588369 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7f1eb4024020 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.355+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec4063900 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.355+0000 7f1ec2ffd700 1 --2- 172.21.15.47:0/1578588369 >> v2:172.21.15.47:6800/4248661693 conn(0x7f1eac038dc0 0x7f1eac03b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.355+0000 7f1ec2ffd700 1 -- 172.21.15.47:0/1578588369 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f1eb400f050 con 0x7f1ec4104c30 2024-04-06T03:28:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.355+0000 7f1ec93dc700 1 --2- 172.21.15.47:0/1578588369 >> v2:172.21.15.47:6800/4248661693 conn(0x7f1eac038dc0 0x7f1eac03b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.355+0000 7f1ec93dc700 1 --2- 172.21.15.47:0/1578588369 >> v2:172.21.15.47:6800/4248661693 conn(0x7f1eac038dc0 0x7f1eac03b280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8006fd0 tx=0x7f1eb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.360+0000 7f1ec2ffd700 1 -- 172.21.15.47:0/1578588369 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1eb402b020 con 0x7f1ec4104c30 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.565+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 --> v2:172.21.15.47:6800/4248661693 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f1ec402dbe0 con 0x7f1eac038dc0 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.565+0000 7f1ec2ffd700 1 -- 172.21.15.47:0/1578588369 <== mgr.14120 v2:172.21.15.47:6800/4248661693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f1ec402dbe0 con 0x7f1eac038dc0 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.567+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 >> v2:172.21.15.47:6800/4248661693 conn(0x7f1eac038dc0 msgr2=0x7f1eac03b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.567+0000 7f1ecbe41700 1 --2- 172.21.15.47:0/1578588369 >> v2:172.21.15.47:6800/4248661693 conn(0x7f1eac038dc0 0x7f1eac03b280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8006fd0 tx=0x7f1eb8006e40 comp rx=0 tx=0).stop 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.567+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 msgr2=0x7f1ec419c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.567+0000 7f1ecbe41700 1 --2- 172.21.15.47:0/1578588369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec419c490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40072a0 tx=0x7f1eb4009610 comp rx=0 tx=0).stop 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.568+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 shutdown_connections 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.568+0000 7f1ecbe41700 1 --2- 172.21.15.47:0/1578588369 >> v2:172.21.15.47:6800/4248661693 conn(0x7f1eac038dc0 0x7f1eac03b280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.568+0000 7f1ecbe41700 1 --2- 172.21.15.47:0/1578588369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ec4104c30 0x7f1ec419c490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.568+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 >> 172.21.15.47:0/1578588369 conn(0x7f1ec4100870 msgr2=0x7f1ec4193020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.568+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 shutdown_connections 2024-04-06T03:28:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:53.568+0000 7f1ecbe41700 1 -- 172.21.15.47:0/1578588369 wait complete. 2024-04-06T03:28:54.191 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-06T03:28:54.191 INFO:teuthology.orchestra.run.smithi047.stdout:Adding key to root@localhost authorized_keys... 2024-04-06T03:28:54.191 INFO:teuthology.orchestra.run.smithi047.stdout:Adding host smithi047... 2024-04-06T03:28:54.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:54 smithi047 ceph-mon[29365]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:28:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:55 smithi047 ceph-mon[29365]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:28:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:28:55 smithi047 ceph-mon[29365]: Deploying cephadm binary to smithi047 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Added host 'smithi047' with addr '172.21.15.47' 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6f082700 1 Processor -- start 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6f082700 1 -- start start 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6f082700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe681091f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6f082700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe68079f40 con 0x7fbe68106e00 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6ce1e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe681091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6ce1e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe681091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48576/0 (socket says 172.21.15.47:48576) 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6ce1e700 1 -- 172.21.15.47:0/455048129 learned_addr learned my addr 172.21.15.47:0/455048129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6ce1e700 1 -- 172.21.15.47:0/455048129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe68109730 con 0x7fbe68106e00 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.616+0000 7fbe6ce1e700 1 --2- 172.21.15.47:0/455048129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe681091f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0098a0 tx=0x7fbe5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346de2b862c8abe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe677fe700 1 -- 172.21.15.47:0/455048129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c004160 con 0x7fbe68106e00 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe677fe700 1 -- 172.21.15.47:0/455048129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fbe5c004300 con 0x7fbe68106e00 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe677fe700 1 -- 172.21.15.47:0/455048129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c011a60 con 0x7fbe68106e00 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe6f082700 1 -- 172.21.15.47:0/455048129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 msgr2=0x7fbe681091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe6f082700 1 --2- 172.21.15.47:0/455048129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe681091f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0098a0 tx=0x7fbe5c009bb0 comp rx=0 tx=0).stop 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe6f082700 1 -- 172.21.15.47:0/455048129 shutdown_connections 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe6f082700 1 --2- 172.21.15.47:0/455048129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe681091f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe6f082700 1 -- 172.21.15.47:0/455048129 >> 172.21.15.47:0/455048129 conn(0x7fbe681007f0 msgr2=0x7fbe68102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe6f082700 1 -- 172.21.15.47:0/455048129 shutdown_connections 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.617+0000 7fbe6f082700 1 -- 172.21.15.47:0/455048129 wait complete. 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6f082700 1 Processor -- start 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6f082700 1 -- start start 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6f082700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe6819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6f082700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6810a620 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6ce1e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe6819a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6ce1e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe6819a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48586/0 (socket says 172.21.15.47:48586) 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6ce1e700 1 -- 172.21.15.47:0/4108287025 learned_addr learned my addr 172.21.15.47:0/4108287025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6ce1e700 1 -- 172.21.15.47:0/4108287025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6819a640 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.618+0000 7fbe6ce1e700 1 --2- 172.21.15.47:0/4108287025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe6819a100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009870 tx=0x7fbe5c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.619+0000 7fbe65ffb700 1 -- 172.21.15.47:0/4108287025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c01a430 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.619+0000 7fbe65ffb700 1 -- 172.21.15.47:0/4108287025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fbe5c01aa60 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.619+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6819a8d0 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.619+0000 7fbe65ffb700 1 -- 172.21.15.47:0/4108287025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0199a0 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.619+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6819d5c0 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.620+0000 7fbe65ffb700 1 -- 172.21.15.47:0/4108287025 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7fbe5c022020 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.620+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe68063900 con 0x7fbe68106e00 2024-04-06T03:28:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.620+0000 7fbe65ffb700 1 --2- 172.21.15.47:0/4108287025 >> v2:172.21.15.47:6800/4248661693 conn(0x7fbe58038dc0 0x7fbe5803b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.620+0000 7fbe65ffb700 1 -- 172.21.15.47:0/4108287025 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fbe5c04cf90 con 0x7fbe68106e00 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.620+0000 7fbe67fff700 1 --2- 172.21.15.47:0/4108287025 >> v2:172.21.15.47:6800/4248661693 conn(0x7fbe58038dc0 0x7fbe5803b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.620+0000 7fbe67fff700 1 --2- 172.21.15.47:0/4108287025 >> v2:172.21.15.47:6800/4248661693 conn(0x7fbe58038dc0 0x7fbe5803b280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbe54006fd0 tx=0x7fbe54006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.625+0000 7fbe65ffb700 1 -- 172.21.15.47:0/4108287025 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fbe5c02bdb0 con 0x7fbe68106e00 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:54.834+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 --> v2:172.21.15.47:6800/4248661693 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}) -- 0x7fbe681018d0 con 0x7fbe58038dc0 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.139+0000 7fbe65ffb700 1 -- 172.21.15.47:0/4108287025 <== mgr.14120 v2:172.21.15.47:6800/4248661693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fbe681018d0 con 0x7fbe58038dc0 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 >> v2:172.21.15.47:6800/4248661693 conn(0x7fbe58038dc0 msgr2=0x7fbe5803b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 --2- 172.21.15.47:0/4108287025 >> v2:172.21.15.47:6800/4248661693 conn(0x7fbe58038dc0 0x7fbe5803b280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbe54006fd0 tx=0x7fbe54006e40 comp rx=0 tx=0).stop 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 msgr2=0x7fbe6819a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:28:59.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 --2- 172.21.15.47:0/4108287025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe6819a100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009870 tx=0x7fbe5c011ae0 comp rx=0 tx=0).stop 2024-04-06T03:28:59.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 shutdown_connections 2024-04-06T03:28:59.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 --2- 172.21.15.47:0/4108287025 >> v2:172.21.15.47:6800/4248661693 conn(0x7fbe58038dc0 0x7fbe5803b280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:59.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 --2- 172.21.15.47:0/4108287025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106e00 0x7fbe6819a100 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:28:59.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 >> 172.21.15.47:0/4108287025 conn(0x7fbe681007f0 msgr2=0x7fbe681011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:28:59.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 shutdown_connections 2024-04-06T03:28:59.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:28:59.142+0000 7fbe6f082700 1 -- 172.21.15.47:0/4108287025 wait complete. 2024-04-06T03:28:59.724 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mon service... 2024-04-06T03:29:00.241 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:00 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:29:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:00 smithi047 ceph-mon[29365]: Added host smithi047 2024-04-06T03:29:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:00 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:01.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-06T03:29:01.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.184+0000 7f7c6b1de700 1 Processor -- start 2024-04-06T03:29:01.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.184+0000 7f7c6b1de700 1 -- start start 2024-04-06T03:29:01.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.184+0000 7f7c6b1de700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6407a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:01.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.184+0000 7f7c6b1de700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6407a9c0 con 0x7f7c6407bf90 2024-04-06T03:29:01.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.184+0000 7f7c68f7a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6407a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:01.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.185+0000 7f7c68f7a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6407a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35054/0 (socket says 172.21.15.47:35054) 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.185+0000 7f7c68f7a700 1 -- 172.21.15.47:0/1993995383 learned_addr learned my addr 172.21.15.47:0/1993995383 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.185+0000 7f7c68f7a700 1 -- 172.21.15.47:0/1993995383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6407ab40 con 0x7f7c6407bf90 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.185+0000 7f7c68f7a700 1 --2- 172.21.15.47:0/1993995383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6407a3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009e80 tx=0x7f7c5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96335eb5b452e839 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.185+0000 7f7c637fe700 1 -- 172.21.15.47:0/1993995383 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c017070 con 0x7f7c6407bf90 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.185+0000 7f7c637fe700 1 -- 172.21.15.47:0/1993995383 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f7c5c00b8c0 con 0x7f7c6407bf90 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.185+0000 7f7c637fe700 1 -- 172.21.15.47:0/1993995383 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c004470 con 0x7f7c6407bf90 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 -- 172.21.15.47:0/1993995383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 msgr2=0x7f7c6407a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 --2- 172.21.15.47:0/1993995383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6407a3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009e80 tx=0x7f7c5c00b330 comp rx=0 tx=0).stop 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 -- 172.21.15.47:0/1993995383 shutdown_connections 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 --2- 172.21.15.47:0/1993995383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6407a3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 -- 172.21.15.47:0/1993995383 >> 172.21.15.47:0/1993995383 conn(0x7f7c641018c0 msgr2=0x7f7c64103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 -- 172.21.15.47:0/1993995383 shutdown_connections 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 -- 172.21.15.47:0/1993995383 wait complete. 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 Processor -- start 2024-04-06T03:29:01.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 -- start start 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.186+0000 7f7c6b1de700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6410c870 con 0x7f7c6407bf90 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c68f7a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c68f7a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6419c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35056/0 (socket says 172.21.15.47:35056) 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c68f7a700 1 -- 172.21.15.47:0/3350735312 learned_addr learned my addr 172.21.15.47:0/3350735312 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c68f7a700 1 -- 172.21.15.47:0/3350735312 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6419c8b0 con 0x7f7c6407bf90 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c68f7a700 1 --2- 172.21.15.47:0/3350735312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6419c370 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0072a0 tx=0x7f7c5c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c61ffb700 1 -- 172.21.15.47:0/3350735312 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c021020 con 0x7f7c6407bf90 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c61ffb700 1 -- 172.21.15.47:0/3350735312 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f7c5c003d40 con 0x7f7c6407bf90 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6419cb40 con 0x7f7c6407bf90 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c61ffb700 1 -- 172.21.15.47:0/3350735312 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c017040 con 0x7f7c6407bf90 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.187+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6419f830 con 0x7f7c6407bf90 2024-04-06T03:29:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.188+0000 7f7c61ffb700 1 -- 172.21.15.47:0/3350735312 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7f7c5c024020 con 0x7f7c6407bf90 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.188+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c64063900 con 0x7f7c6407bf90 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.188+0000 7f7c61ffb700 1 --2- 172.21.15.47:0/3350735312 >> v2:172.21.15.47:6800/4248661693 conn(0x7f7c4c038dc0 0x7f7c4c03b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.188+0000 7f7c61ffb700 1 -- 172.21.15.47:0/3350735312 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f7c5c00f050 con 0x7f7c6407bf90 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.188+0000 7f7c63fff700 1 --2- 172.21.15.47:0/3350735312 >> v2:172.21.15.47:6800/4248661693 conn(0x7f7c4c038dc0 0x7f7c4c03b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.189+0000 7f7c63fff700 1 --2- 172.21.15.47:0/3350735312 >> v2:172.21.15.47:6800/4248661693 conn(0x7f7c4c038dc0 0x7f7c4c03b280 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c58006fd0 tx=0x7f7c58006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.193+0000 7f7c61ffb700 1 -- 172.21.15.47:0/3350735312 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7c5c02b020 con 0x7f7c6407bf90 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.412+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 --> v2:172.21.15.47:6800/4248661693 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7c64102a40 con 0x7f7c4c038dc0 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.416+0000 7f7c61ffb700 1 -- 172.21.15.47:0/3350735312 <== mgr.14120 v2:172.21.15.47:6800/4248661693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7c64102a40 con 0x7f7c4c038dc0 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 >> v2:172.21.15.47:6800/4248661693 conn(0x7f7c4c038dc0 msgr2=0x7f7c4c03b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 --2- 172.21.15.47:0/3350735312 >> v2:172.21.15.47:6800/4248661693 conn(0x7f7c4c038dc0 0x7f7c4c03b280 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c58006fd0 tx=0x7f7c58006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 msgr2=0x7f7c6419c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 --2- 172.21.15.47:0/3350735312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6419c370 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0072a0 tx=0x7f7c5c009610 comp rx=0 tx=0).stop 2024-04-06T03:29:01.231 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 shutdown_connections 2024-04-06T03:29:01.232 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 --2- 172.21.15.47:0/3350735312 >> v2:172.21.15.47:6800/4248661693 conn(0x7f7c4c038dc0 0x7f7c4c03b280 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:01.232 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 --2- 172.21.15.47:0/3350735312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6407bf90 0x7f7c6419c370 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:01.232 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 >> 172.21.15.47:0/3350735312 conn(0x7f7c641018c0 msgr2=0x7f7c64102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:01.232 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 shutdown_connections 2024-04-06T03:29:01.232 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:00.418+0000 7f7c6b1de700 1 -- 172.21.15.47:0/3350735312 wait complete. 2024-04-06T03:29:01.232 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mgr service... 2024-04-06T03:29:01.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:01 smithi047 ceph-mon[29365]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:01.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:01 smithi047 ceph-mon[29365]: Saving service mon spec with placement count:5 2024-04-06T03:29:01.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:01 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:29:03.241 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:02 smithi047 ceph-mon[29365]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:03.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:02 smithi047 ceph-mon[29365]: Saving service mgr spec with placement count:2 2024-04-06T03:29:03.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:02 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:29:03.359 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.711+0000 7f928b2bf700 1 Processor -- start 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.711+0000 7f928b2bf700 1 -- start start 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.711+0000 7f928b2bf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f9284107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.711+0000 7f928b2bf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9284105f60 con 0x7f9284107a20 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.711+0000 7f928905b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f9284107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.711+0000 7f928905b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f9284107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35070/0 (socket says 172.21.15.47:35070) 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.711+0000 7f928905b700 1 -- 172.21.15.47:0/183743863 learned_addr learned my addr 172.21.15.47:0/183743863 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.711+0000 7f928905b700 1 -- 172.21.15.47:0/183743863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92841060e0 con 0x7f9284107a20 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.712+0000 7f928905b700 1 --2- 172.21.15.47:0/183743863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f9284107e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9274009e80 tx=0x7f927400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d471d08da6a5f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.712+0000 7f9283fff700 1 -- 172.21.15.47:0/183743863 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9274017070 con 0x7f9284107a20 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.712+0000 7f9283fff700 1 -- 172.21.15.47:0/183743863 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f927400b8c0 con 0x7f9284107a20 2024-04-06T03:29:03.360 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.712+0000 7f9283fff700 1 -- 172.21.15.47:0/183743863 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9274004470 con 0x7f9284107a20 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.712+0000 7f928b2bf700 1 -- 172.21.15.47:0/183743863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 msgr2=0x7f9284107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.712+0000 7f928b2bf700 1 --2- 172.21.15.47:0/183743863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f9284107e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9274009e80 tx=0x7f927400b330 comp rx=0 tx=0).stop 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.713+0000 7f928b2bf700 1 -- 172.21.15.47:0/183743863 shutdown_connections 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.713+0000 7f928b2bf700 1 --2- 172.21.15.47:0/183743863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f9284107e40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.713+0000 7f928b2bf700 1 -- 172.21.15.47:0/183743863 >> 172.21.15.47:0/183743863 conn(0x7f92841018c0 msgr2=0x7f9284103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.713+0000 7f928b2bf700 1 -- 172.21.15.47:0/183743863 shutdown_connections 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.713+0000 7f928b2bf700 1 -- 172.21.15.47:0/183743863 wait complete. 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.713+0000 7f928b2bf700 1 Processor -- start 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.713+0000 7f928b2bf700 1 -- start start 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928b2bf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f928419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928b2bf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f928410a8f0 con 0x7f9284107a20 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928905b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f928419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928905b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f928419a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35080/0 (socket says 172.21.15.47:35080) 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928905b700 1 -- 172.21.15.47:0/2202133753 learned_addr learned my addr 172.21.15.47:0/2202133753 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928905b700 1 -- 172.21.15.47:0/2202133753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928419a800 con 0x7f9284107a20 2024-04-06T03:29:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928905b700 1 --2- 172.21.15.47:0/2202133753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f928419a2c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92740072a0 tx=0x7f92740095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f92827fc700 1 -- 172.21.15.47:0/2202133753 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9274021020 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928419aa90 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f92827fc700 1 -- 172.21.15.47:0/2202133753 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f9274003d40 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f92827fc700 1 -- 172.21.15.47:0/2202133753 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9274017040 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.714+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928419d780 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.715+0000 7f92827fc700 1 -- 172.21.15.47:0/2202133753 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7f9274024020 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.715+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9284063900 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.715+0000 7f92827fc700 1 --2- 172.21.15.47:0/2202133753 >> v2:172.21.15.47:6800/4248661693 conn(0x7f926c038d70 0x7f926c03b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.715+0000 7f92827fc700 1 -- 172.21.15.47:0/2202133753 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f927400f050 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.716+0000 7f928885a700 1 --2- 172.21.15.47:0/2202133753 >> v2:172.21.15.47:6800/4248661693 conn(0x7f926c038d70 0x7f926c03b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.716+0000 7f928885a700 1 --2- 172.21.15.47:0/2202133753 >> v2:172.21.15.47:6800/4248661693 conn(0x7f926c038d70 0x7f926c03b230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9278006fd0 tx=0x7f9278006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.720+0000 7f92827fc700 1 -- 172.21.15.47:0/2202133753 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f927402b020 con 0x7f9284107a20 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.940+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 --> v2:172.21.15.47:6800/4248661693 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f9284102ab0 con 0x7f926c038d70 2024-04-06T03:29:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.944+0000 7f92827fc700 1 -- 172.21.15.47:0/2202133753 <== mgr.14120 v2:172.21.15.47:6800/4248661693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9284102ab0 con 0x7f926c038d70 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 >> v2:172.21.15.47:6800/4248661693 conn(0x7f926c038d70 msgr2=0x7f926c03b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 --2- 172.21.15.47:0/2202133753 >> v2:172.21.15.47:6800/4248661693 conn(0x7f926c038d70 0x7f926c03b230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9278006fd0 tx=0x7f9278006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 msgr2=0x7f928419a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 --2- 172.21.15.47:0/2202133753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f928419a2c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92740072a0 tx=0x7f92740095a0 comp rx=0 tx=0).stop 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 shutdown_connections 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 --2- 172.21.15.47:0/2202133753 >> v2:172.21.15.47:6800/4248661693 conn(0x7f926c038d70 0x7f926c03b230 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 --2- 172.21.15.47:0/2202133753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9284107a20 0x7f928419a2c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 >> 172.21.15.47:0/2202133753 conn(0x7f92841018c0 msgr2=0x7f92841023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 shutdown_connections 2024-04-06T03:29:03.363 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:01.946+0000 7f928b2bf700 1 -- 172.21.15.47:0/2202133753 wait complete. 2024-04-06T03:29:04.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:03 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:29:04.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:03 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:29:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.794+0000 7fa77add3700 1 Processor -- start 2024-04-06T03:29:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.794+0000 7fa77add3700 1 -- start start 2024-04-06T03:29:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.794+0000 7fa77add3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa774105050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.794+0000 7fa77add3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa7740797b0 con 0x7fa774104c30 2024-04-06T03:29:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.794+0000 7fa778b6f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa774105050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.795+0000 7fa778b6f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa774105050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35090/0 (socket says 172.21.15.47:35090) 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.795+0000 7fa778b6f700 1 -- 172.21.15.47:0/3478714391 learned_addr learned my addr 172.21.15.47:0/3478714391 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.795+0000 7fa778b6f700 1 -- 172.21.15.47:0/3478714391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa774105590 con 0x7fa774104c30 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.795+0000 7fa778b6f700 1 --2- 172.21.15.47:0/3478714391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa774105050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7680098a0 tx=0x7fa768009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbbc7e7db9441a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.795+0000 7fa7737fe700 1 -- 172.21.15.47:0/3478714391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa768004160 con 0x7fa774104c30 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.795+0000 7fa7737fe700 1 -- 172.21.15.47:0/3478714391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fa768004300 con 0x7fa774104c30 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.795+0000 7fa7737fe700 1 -- 172.21.15.47:0/3478714391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa768011a00 con 0x7fa774104c30 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.796+0000 7fa77add3700 1 -- 172.21.15.47:0/3478714391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 msgr2=0x7fa774105050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.796+0000 7fa77add3700 1 --2- 172.21.15.47:0/3478714391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa774105050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7680098a0 tx=0x7fa768009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.796+0000 7fa77add3700 1 -- 172.21.15.47:0/3478714391 shutdown_connections 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.796+0000 7fa77add3700 1 --2- 172.21.15.47:0/3478714391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa774105050 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.796+0000 7fa77add3700 1 -- 172.21.15.47:0/3478714391 >> 172.21.15.47:0/3478714391 conn(0x7fa774100870 msgr2=0x7fa774102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.796+0000 7fa77add3700 1 -- 172.21.15.47:0/3478714391 shutdown_connections 2024-04-06T03:29:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.796+0000 7fa77add3700 1 -- 172.21.15.47:0/3478714391 wait complete. 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa77add3700 1 Processor -- start 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa77add3700 1 -- start start 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa77add3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa77419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa77add3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa774106600 con 0x7fa774104c30 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa778b6f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa77419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa778b6f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa77419c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35104/0 (socket says 172.21.15.47:35104) 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa778b6f700 1 -- 172.21.15.47:0/1508439475 learned_addr learned my addr 172.21.15.47:0/1508439475 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa778b6f700 1 -- 172.21.15.47:0/1508439475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77419c9c0 con 0x7fa774104c30 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa778b6f700 1 --2- 172.21.15.47:0/1508439475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa77419c480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa768009870 tx=0x7fa768011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa771ffb700 1 -- 172.21.15.47:0/1508439475 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa768003af0 con 0x7fa774104c30 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa771ffb700 1 -- 172.21.15.47:0/1508439475 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fa76801a8e0 con 0x7fa774104c30 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa771ffb700 1 -- 172.21.15.47:0/1508439475 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7680248d0 con 0x7fa774104c30 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.797+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77419cc50 con 0x7fa774104c30 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.798+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77419f940 con 0x7fa774104c30 2024-04-06T03:29:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.799+0000 7fa771ffb700 1 -- 172.21.15.47:0/1508439475 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7fa768022020 con 0x7fa774104c30 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.799+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa774063900 con 0x7fa774104c30 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.799+0000 7fa771ffb700 1 --2- 172.21.15.47:0/1508439475 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa764038f60 0x7fa76403b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.799+0000 7fa771ffb700 1 -- 172.21.15.47:0/1508439475 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fa76804cf00 con 0x7fa774104c30 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.799+0000 7fa773fff700 1 --2- 172.21.15.47:0/1508439475 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa764038f60 0x7fa76403b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.799+0000 7fa773fff700 1 --2- 172.21.15.47:0/1508439475 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa764038f60 0x7fa76403b420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa760006fd0 tx=0x7fa760006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:03.808+0000 7fa771ffb700 1 -- 172.21.15.47:0/1508439475 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa76800f2e0 con 0x7fa774104c30 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.011+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fa7741958e0 con 0x7fa774104c30 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.013+0000 7fa771ffb700 1 -- 172.21.15.47:0/1508439475 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fa76804cc60 con 0x7fa774104c30 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa764038f60 msgr2=0x7fa76403b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 --2- 172.21.15.47:0/1508439475 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa764038f60 0x7fa76403b420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa760006fd0 tx=0x7fa760006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 msgr2=0x7fa77419c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 --2- 172.21.15.47:0/1508439475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa77419c480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa768009870 tx=0x7fa768011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 shutdown_connections 2024-04-06T03:29:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 --2- 172.21.15.47:0/1508439475 >> v2:172.21.15.47:6800/4248661693 conn(0x7fa764038f60 0x7fa76403b420 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 --2- 172.21.15.47:0/1508439475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa774104c30 0x7fa77419c480 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 >> 172.21.15.47:0/1508439475 conn(0x7fa774100870 msgr2=0x7fa774193040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 shutdown_connections 2024-04-06T03:29:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.016+0000 7fa77add3700 1 -- 172.21.15.47:0/1508439475 wait complete. 2024-04-06T03:29:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1508439475' entity='client.admin' 2024-04-06T03:29:05.832 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.935+0000 7f62627ce700 1 Processor -- start 2024-04-06T03:29:05.832 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.935+0000 7f62627ce700 1 -- start start 2024-04-06T03:29:05.832 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.935+0000 7f62627ce700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c107e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:05.832 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.935+0000 7f62627ce700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f625c108440 con 0x7f625c107a50 2024-04-06T03:29:05.832 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.935+0000 7f625bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c107e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:05.832 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.935+0000 7f625bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c107e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35112/0 (socket says 172.21.15.47:35112) 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.935+0000 7f625bfff700 1 -- 172.21.15.47:0/4010059529 learned_addr learned my addr 172.21.15.47:0/4010059529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.936+0000 7f625bfff700 1 -- 172.21.15.47:0/4010059529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c104350 con 0x7f625c107a50 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.936+0000 7f625bfff700 1 --2- 172.21.15.47:0/4010059529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c107e70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f624c0098a0 tx=0x7f624c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868034c97c14b441 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.936+0000 7f625affd700 1 -- 172.21.15.47:0/4010059529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c004160 con 0x7f625c107a50 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.936+0000 7f625affd700 1 -- 172.21.15.47:0/4010059529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f624c004300 con 0x7f625c107a50 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.936+0000 7f625affd700 1 -- 172.21.15.47:0/4010059529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c011a00 con 0x7f625c107a50 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.937+0000 7f62627ce700 1 -- 172.21.15.47:0/4010059529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 msgr2=0x7f625c107e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.937+0000 7f62627ce700 1 --2- 172.21.15.47:0/4010059529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c107e70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f624c0098a0 tx=0x7f624c009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.937+0000 7f62627ce700 1 -- 172.21.15.47:0/4010059529 shutdown_connections 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.937+0000 7f62627ce700 1 --2- 172.21.15.47:0/4010059529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c107e70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.937+0000 7f62627ce700 1 -- 172.21.15.47:0/4010059529 >> 172.21.15.47:0/4010059529 conn(0x7f625c0ffff0 msgr2=0x7f625c102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.937+0000 7f62627ce700 1 -- 172.21.15.47:0/4010059529 shutdown_connections 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.937+0000 7f62627ce700 1 -- 172.21.15.47:0/4010059529 wait complete. 2024-04-06T03:29:05.833 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.938+0000 7f62627ce700 1 Processor -- start 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.938+0000 7f62627ce700 1 -- start start 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.938+0000 7f62627ce700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.938+0000 7f62627ce700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f625c10aa20 con 0x7f625c107a50 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.938+0000 7f625bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.938+0000 7f625bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35114/0 (socket says 172.21.15.47:35114) 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.938+0000 7f625bfff700 1 -- 172.21.15.47:0/3025561585 learned_addr learned my addr 172.21.15.47:0/3025561585 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.939+0000 7f625bfff700 1 -- 172.21.15.47:0/3025561585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c19a870 con 0x7f625c107a50 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.939+0000 7f625bfff700 1 --2- 172.21.15.47:0/3025561585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c19a330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f624c009fb0 tx=0x7f624c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.939+0000 7f62597fa700 1 -- 172.21.15.47:0/3025561585 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c01a430 con 0x7f625c107a50 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.939+0000 7f62597fa700 1 -- 172.21.15.47:0/3025561585 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f624c01aa80 con 0x7f625c107a50 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.939+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c19ab00 con 0x7f625c107a50 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.939+0000 7f62597fa700 1 -- 172.21.15.47:0/3025561585 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c0249b0 con 0x7f625c107a50 2024-04-06T03:29:05.834 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.939+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c19af60 con 0x7f625c107a50 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.940+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625c063900 con 0x7f625c107a50 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.940+0000 7f62597fa700 1 -- 172.21.15.47:0/3025561585 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7f624c022020 con 0x7f625c107a50 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.940+0000 7f62597fa700 1 --2- 172.21.15.47:0/3025561585 >> v2:172.21.15.47:6800/4248661693 conn(0x7f6244038d70 0x7f624403b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.941+0000 7f62597fa700 1 -- 172.21.15.47:0/3025561585 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f624c04d130 con 0x7f625c107a50 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.941+0000 7f625b7fe700 1 --2- 172.21.15.47:0/3025561585 >> v2:172.21.15.47:6800/4248661693 conn(0x7f6244038d70 0x7f624403b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.941+0000 7f625b7fe700 1 --2- 172.21.15.47:0/3025561585 >> v2:172.21.15.47:6800/4248661693 conn(0x7f6244038d70 0x7f624403b230 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6250006fd0 tx=0x7f6250006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:04.946+0000 7f62597fa700 1 -- 172.21.15.47:0/3025561585 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f624c0172b0 con 0x7f625c107a50 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.170+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f625c19dab0 con 0x7f625c107a50 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.173+0000 7f62597fa700 1 -- 172.21.15.47:0/3025561585 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f624c00fdd0 con 0x7f625c107a50 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 >> v2:172.21.15.47:6800/4248661693 conn(0x7f6244038d70 msgr2=0x7f624403b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 --2- 172.21.15.47:0/3025561585 >> v2:172.21.15.47:6800/4248661693 conn(0x7f6244038d70 0x7f624403b230 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6250006fd0 tx=0x7f6250006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 msgr2=0x7f625c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 --2- 172.21.15.47:0/3025561585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c19a330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f624c009fb0 tx=0x7f624c011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:05.835 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 shutdown_connections 2024-04-06T03:29:05.836 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 --2- 172.21.15.47:0/3025561585 >> v2:172.21.15.47:6800/4248661693 conn(0x7f6244038d70 0x7f624403b230 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:05.836 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 --2- 172.21.15.47:0/3025561585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f625c107a50 0x7f625c19a330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:05.836 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 >> 172.21.15.47:0/3025561585 conn(0x7f625c0ffff0 msgr2=0x7f625c100a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:05.836 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 shutdown_connections 2024-04-06T03:29:05.836 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:05.175+0000 7f62627ce700 1 -- 172.21.15.47:0/3025561585 wait complete. 2024-04-06T03:29:05.836 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling the dashboard module... 2024-04-06T03:29:06.446 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3025561585' entity='client.admin' 2024-04-06T03:29:07.661 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:07 smithi047 ceph-mon[29365]: from='mgr.14120 172.21.15.47:0/2760970674' entity='mgr.y' 2024-04-06T03:29:07.661 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/574645850' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-06T03:29:07.661 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:07 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ignoring --setuser ceph since I am not root 2024-04-06T03:29:07.662 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:07 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ignoring --setgroup ceph since I am not root 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.552+0000 7fcfb6635700 1 Processor -- start 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.552+0000 7fcfb6635700 1 -- start start 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.552+0000 7fcfb6635700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb0106750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.552+0000 7fcfb6635700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb0106d20 con 0x7fcfb0106330 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.552+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb0106750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.552+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb0106750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59964/0 (socket says 172.21.15.47:59964) 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.552+0000 7fcfaffff700 1 -- 172.21.15.47:0/2348223242 learned_addr learned my addr 172.21.15.47:0/2348223242 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.553+0000 7fcfaffff700 1 -- 172.21.15.47:0/2348223242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb0107530 con 0x7fcfb0106330 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.553+0000 7fcfaffff700 1 --2- 172.21.15.47:0/2348223242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb0106750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00098a0 tx=0x7fcfa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd88602e92a6aa31 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:07.951 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.553+0000 7fcfaeffd700 1 -- 172.21.15.47:0/2348223242 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa0004160 con 0x7fcfb0106330 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.553+0000 7fcfaeffd700 1 -- 172.21.15.47:0/2348223242 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fcfa0004300 con 0x7fcfb0106330 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.553+0000 7fcfaeffd700 1 -- 172.21.15.47:0/2348223242 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa0011a00 con 0x7fcfb0106330 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.553+0000 7fcfb6635700 1 -- 172.21.15.47:0/2348223242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 msgr2=0x7fcfb0106750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.553+0000 7fcfb6635700 1 --2- 172.21.15.47:0/2348223242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb0106750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00098a0 tx=0x7fcfa0009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.554+0000 7fcfb6635700 1 -- 172.21.15.47:0/2348223242 shutdown_connections 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.554+0000 7fcfb6635700 1 --2- 172.21.15.47:0/2348223242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb0106750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.554+0000 7fcfb6635700 1 -- 172.21.15.47:0/2348223242 >> 172.21.15.47:0/2348223242 conn(0x7fcfb01018d0 msgr2=0x7fcfb0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.554+0000 7fcfb6635700 1 -- 172.21.15.47:0/2348223242 shutdown_connections 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.554+0000 7fcfb6635700 1 -- 172.21.15.47:0/2348223242 wait complete. 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.554+0000 7fcfb6635700 1 Processor -- start 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.554+0000 7fcfb6635700 1 -- start start 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfb6635700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfb6635700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb010a8e0 con 0x7fcfb0106330 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:07.952 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59968/0 (socket says 172.21.15.47:59968) 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfaffff700 1 -- 172.21.15.47:0/574645850 learned_addr learned my addr 172.21.15.47:0/574645850 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfaffff700 1 -- 172.21.15.47:0/574645850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb019a790 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfaffff700 1 --2- 172.21.15.47:0/574645850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb019a250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009fb0 tx=0x7fcfa0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfad7fa700 1 -- 172.21.15.47:0/574645850 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa0003aa0 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfad7fa700 1 -- 172.21.15.47:0/574645850 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fcfa001a8e0 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.555+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb019aa20 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.556+0000 7fcfad7fa700 1 -- 172.21.15.47:0/574645850 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa0024930 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.556+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb019d710 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.557+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb010aa60 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.557+0000 7fcfad7fa700 1 -- 172.21.15.47:0/574645850 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 46080+0+0 (secure 0 0 0) 0x7fcfa0022020 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.557+0000 7fcfad7fa700 1 --2- 172.21.15.47:0/574645850 >> v2:172.21.15.47:6800/4248661693 conn(0x7fcf98038d70 0x7fcf9803b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.557+0000 7fcfad7fa700 1 -- 172.21.15.47:0/574645850 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fcfa004d220 con 0x7fcfb0106330 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.557+0000 7fcfaf7fe700 1 --2- 172.21.15.47:0/574645850 >> v2:172.21.15.47:6800/4248661693 conn(0x7fcf98038d70 0x7fcf9803b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.557+0000 7fcfaf7fe700 1 --2- 172.21.15.47:0/574645850 >> v2:172.21.15.47:6800/4248661693 conn(0x7fcf98038d70 0x7fcf9803b230 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4006fd0 tx=0x7fcfa4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.562+0000 7fcfad7fa700 1 -- 172.21.15.47:0/574645850 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcfa001ad70 con 0x7fcfb0106330 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:06.824+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fcfb019daa0 con 0x7fcfb0106330 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.388+0000 7fcfad7fa700 1 -- 172.21.15.47:0/574645850 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fcfa004cf80 con 0x7fcfb0106330 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.389+0000 7fcfad7fa700 1 -- 172.21.15.47:0/574645850 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mgrmap(e 9) ==== 46093+0+0 (secure 0 0 0) 0x7fcfa002dc90 con 0x7fcfb0106330 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 >> v2:172.21.15.47:6800/4248661693 conn(0x7fcf98038d70 msgr2=0x7fcf9803b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 --2- 172.21.15.47:0/574645850 >> v2:172.21.15.47:6800/4248661693 conn(0x7fcf98038d70 0x7fcf9803b230 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4006fd0 tx=0x7fcfa4006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 msgr2=0x7fcfb019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 --2- 172.21.15.47:0/574645850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb019a250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009fb0 tx=0x7fcfa0011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 shutdown_connections 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 --2- 172.21.15.47:0/574645850 >> v2:172.21.15.47:6800/4248661693 conn(0x7fcf98038d70 0x7fcf9803b230 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 --2- 172.21.15.47:0/574645850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfb0106330 0x7fcfb019a250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 >> 172.21.15.47:0/574645850 conn(0x7fcfb01018d0 msgr2=0x7fcfb01023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 shutdown_connections 2024-04-06T03:29:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:07.391+0000 7fcfb6635700 1 -- 172.21.15.47:0/574645850 wait complete. 2024-04-06T03:29:08.192 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:07 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:07.989+0000 7f28c6fa9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-06T03:29:08.192 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:08 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:08.084+0000 7f28c6fa9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-06T03:29:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/574645850' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-06T03:29:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:08 smithi047 ceph-mon[29365]: mgrmap e9: y(active, since 19s) 2024-04-06T03:29:08.854 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:08 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:08.759+0000 7f28c6fa9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-06T03:29:08.854 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:08 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:08.854+0000 7f28c6fa9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-06T03:29:09.185 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:09.000+0000 7f28c6fa9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-06T03:29:09.185 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:09.098+0000 7f28c6fa9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-06T03:29:09.185 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:09.184+0000 7f28c6fa9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.396+0000 7fe8d18bd700 1 Processor -- start 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.396+0000 7fe8d18bd700 1 -- start start 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.396+0000 7fe8d18bd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc106750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.396+0000 7fe8d18bd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc106d20 con 0x7fe8cc106330 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.397+0000 7fe8caffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc106750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.397+0000 7fe8caffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc106750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59996/0 (socket says 172.21.15.47:59996) 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.397+0000 7fe8caffd700 1 -- 172.21.15.47:0/847453257 learned_addr learned my addr 172.21.15.47:0/847453257 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.397+0000 7fe8caffd700 1 -- 172.21.15.47:0/847453257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc107530 con 0x7fe8cc106330 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.397+0000 7fe8caffd700 1 --2- 172.21.15.47:0/847453257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc106750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0098a0 tx=0x7fe8bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51130a2dadb79369 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.397+0000 7fe8c9ffb700 1 -- 172.21.15.47:0/847453257 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8bc004160 con 0x7fe8cc106330 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.397+0000 7fe8c9ffb700 1 -- 172.21.15.47:0/847453257 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe8bc004300 con 0x7fe8cc106330 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.397+0000 7fe8c9ffb700 1 -- 172.21.15.47:0/847453257 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8bc011a00 con 0x7fe8cc106330 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.398+0000 7fe8d18bd700 1 -- 172.21.15.47:0/847453257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 msgr2=0x7fe8cc106750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.398+0000 7fe8d18bd700 1 --2- 172.21.15.47:0/847453257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc106750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0098a0 tx=0x7fe8bc009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.398+0000 7fe8d18bd700 1 -- 172.21.15.47:0/847453257 shutdown_connections 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.398+0000 7fe8d18bd700 1 --2- 172.21.15.47:0/847453257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc106750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.398+0000 7fe8d18bd700 1 -- 172.21.15.47:0/847453257 >> 172.21.15.47:0/847453257 conn(0x7fe8cc1018f0 msgr2=0x7fe8cc103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.398+0000 7fe8d18bd700 1 -- 172.21.15.47:0/847453257 shutdown_connections 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.398+0000 7fe8d18bd700 1 -- 172.21.15.47:0/847453257 wait complete. 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.398+0000 7fe8d18bd700 1 Processor -- start 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.399+0000 7fe8d18bd700 1 -- start start 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.399+0000 7fe8d18bd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc07bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.399+0000 7fe8d18bd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc10a8e0 con 0x7fe8cc106330 2024-04-06T03:29:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.399+0000 7fe8caffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc07bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.399+0000 7fe8caffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc07bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60010/0 (socket says 172.21.15.47:60010) 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.399+0000 7fe8caffd700 1 -- 172.21.15.47:0/3842931981 learned_addr learned my addr 172.21.15.47:0/3842931981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.399+0000 7fe8caffd700 1 -- 172.21.15.47:0/3842931981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc07c1c0 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.399+0000 7fe8caffd700 1 --2- 172.21.15.47:0/3842931981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc07bc80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009fb0 tx=0x7fe8bc011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.400+0000 7fe8d08bb700 1 -- 172.21.15.47:0/3842931981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8bc003aa0 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.400+0000 7fe8d08bb700 1 -- 172.21.15.47:0/3842931981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe8bc01a8e0 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.400+0000 7fe8d08bb700 1 -- 172.21.15.47:0/3842931981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8bc024930 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.400+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8cc07a3b0 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.400+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8cc07a8f0 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.400+0000 7fe8d08bb700 1 -- 172.21.15.47:0/3842931981 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 9) ==== 46093+0+0 (secure 0 0 0) 0x7fe8bc022020 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.400+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8cc10aa60 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.401+0000 7fe8d08bb700 1 --2- 172.21.15.47:0/3842931981 >> v2:172.21.15.47:6800/4248661693 conn(0x7fe8b4038dc0 0x7fe8b403b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.401+0000 7fe8d08bb700 1 -- 172.21.15.47:0/3842931981 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fe8bc04d190 con 0x7fe8cc106330 2024-04-06T03:29:09.242 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.401+0000 7fe8ca7fc700 1 -- 172.21.15.47:0/3842931981 >> v2:172.21.15.47:6800/4248661693 conn(0x7fe8b4038dc0 msgr2=0x7fe8b403b280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/4248661693 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.401+0000 7fe8ca7fc700 1 --2- 172.21.15.47:0/3842931981 >> v2:172.21.15.47:6800/4248661693 conn(0x7fe8b4038dc0 0x7fe8b403b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.405+0000 7fe8d08bb700 1 -- 172.21.15.47:0/3842931981 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe8bc00b3e0 con 0x7fe8cc106330 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.602+0000 7fe8ca7fc700 1 -- 172.21.15.47:0/3842931981 >> v2:172.21.15.47:6800/4248661693 conn(0x7fe8b4038dc0 msgr2=0x7fe8b403b280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/4248661693 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.602+0000 7fe8ca7fc700 1 --2- 172.21.15.47:0/3842931981 >> v2:172.21.15.47:6800/4248661693 conn(0x7fe8b4038dc0 0x7fe8b403b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.667+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe8cc07af90 con 0x7fe8cc106330 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.668+0000 7fe8d08bb700 1 -- 172.21.15.47:0/3842931981 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fe8bc01ad70 con 0x7fe8cc106330 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 >> v2:172.21.15.47:6800/4248661693 conn(0x7fe8b4038dc0 msgr2=0x7fe8b403b280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 --2- 172.21.15.47:0/3842931981 >> v2:172.21.15.47:6800/4248661693 conn(0x7fe8b4038dc0 0x7fe8b403b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 msgr2=0x7fe8cc07bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 --2- 172.21.15.47:0/3842931981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc07bc80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009fb0 tx=0x7fe8bc011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 shutdown_connections 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 --2- 172.21.15.47:0/3842931981 >> v2:172.21.15.47:6800/4248661693 conn(0x7fe8b4038dc0 0x7fe8b403b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 --2- 172.21.15.47:0/3842931981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc106330 0x7fe8cc07bc80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 >> 172.21.15.47:0/3842931981 conn(0x7fe8cc1018f0 msgr2=0x7fe8cc102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 shutdown_connections 2024-04-06T03:29:09.244 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:08.670+0000 7fe8d18bd700 1 -- 172.21.15.47:0/3842931981 wait complete. 2024-04-06T03:29:09.244 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-04-06T03:29:09.244 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 9... 2024-04-06T03:29:09.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3842931981' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-06T03:29:09.741 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:09.463+0000 7f28c6fa9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-06T03:29:09.742 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:09.577+0000 7f28c6fa9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-06T03:29:09.742 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:09.669+0000 7f28c6fa9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-06T03:29:10.241 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:09.766+0000 7f28c6fa9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-06T03:29:10.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:09 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:09.945+0000 7f28c6fa9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-06T03:29:11.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:10 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:10.929+0000 7f28c6fa9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-06T03:29:11.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:11 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:11.063+0000 7f28c6fa9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-06T03:29:11.696 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:11 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:11.403+0000 7f28c6fa9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-06T03:29:11.696 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:11 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:11.495+0000 7f28c6fa9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-06T03:29:11.697 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:11 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:11.696+0000 7f28c6fa9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:29:11.991 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:11 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:11.886+0000 7f28c6fa9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-06T03:29:12.439 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:12 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:12.177+0000 7f28c6fa9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:29:12.741 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:12 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:12.439+0000 7f28c6fa9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-06T03:29:12.742 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:12 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:12.683+0000 7f28c6fa9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-06T03:29:13.991 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:13.510+0000 7f28c6fa9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-06T03:29:14.418 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:14.093+0000 7f28c6fa9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-06T03:29:14.419 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:14.194+0000 7f28c6fa9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-06T03:29:14.419 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:29:14.418+0000 7f28c6fa9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: Active manager daemon y restarted 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: Activating manager daemon y 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: osdmap e3: 0 total, 0 up, 0 in 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: mgrmap e10: y(active, starting, since 0.00319374s) 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T03:29:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T03:29:14.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: Manager daemon y is now available 2024-04-06T03:29:14.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: [06/Apr/2024:03:29:14] ENGINE Bus STARTING 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: [06/Apr/2024:03:29:15] ENGINE Serving on http://172.21.15.47:8765 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: [06/Apr/2024:03:29:15] ENGINE Serving on https://172.21.15.47:7150 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: [06/Apr/2024:03:29:15] ENGINE Bus STARTED 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: mgrmap e11: y(active, since 1.0059s) 2024-04-06T03:29:15.710 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:15 smithi047 ceph-mon[29365]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-06T03:29:16.366 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-04-06T03:29:16.366 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-06T03:29:16.366 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.651+0000 7f4eb0665700 1 Processor -- start 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.651+0000 7f4eb0665700 1 -- start start 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.651+0000 7f4eb0665700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8105620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.651+0000 7f4eb0665700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea8105bf0 con 0x7f4ea8105200 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.652+0000 7f4eae401700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.652+0000 7f4eae401700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8105620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60026/0 (socket says 172.21.15.47:60026) 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.652+0000 7f4eae401700 1 -- 172.21.15.47:0/3340541977 learned_addr learned my addr 172.21.15.47:0/3340541977 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.652+0000 7f4eae401700 1 -- 172.21.15.47:0/3340541977 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea8106400 con 0x7f4ea8105200 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.652+0000 7f4eae401700 1 --2- 172.21.15.47:0/3340541977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8105620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40098a0 tx=0x7f4ea4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eeb6225c36b5e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.652+0000 7f4ead3ff700 1 -- 172.21.15.47:0/3340541977 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ea4004160 con 0x7f4ea8105200 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.652+0000 7f4ead3ff700 1 -- 172.21.15.47:0/3340541977 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f4ea4004300 con 0x7f4ea8105200 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.652+0000 7f4ead3ff700 1 -- 172.21.15.47:0/3340541977 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ea4011a00 con 0x7f4ea8105200 2024-04-06T03:29:16.367 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.653+0000 7f4eb0665700 1 -- 172.21.15.47:0/3340541977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 msgr2=0x7f4ea8105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.653+0000 7f4eb0665700 1 --2- 172.21.15.47:0/3340541977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8105620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40098a0 tx=0x7f4ea4009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.653+0000 7f4eb0665700 1 -- 172.21.15.47:0/3340541977 shutdown_connections 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.653+0000 7f4eb0665700 1 --2- 172.21.15.47:0/3340541977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8105620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.653+0000 7f4eb0665700 1 -- 172.21.15.47:0/3340541977 >> 172.21.15.47:0/3340541977 conn(0x7f4ea8100820 msgr2=0x7f4ea8102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.653+0000 7f4eb0665700 1 -- 172.21.15.47:0/3340541977 shutdown_connections 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.653+0000 7f4eb0665700 1 -- 172.21.15.47:0/3340541977 wait complete. 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.654+0000 7f4eb0665700 1 Processor -- start 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.654+0000 7f4eb0665700 1 -- start start 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.654+0000 7f4eb0665700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8102bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.654+0000 7f4eb0665700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea81097b0 con 0x7f4ea8105200 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.654+0000 7f4eae401700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8102bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.654+0000 7f4eae401700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8102bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60042/0 (socket says 172.21.15.47:60042) 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.654+0000 7f4eae401700 1 -- 172.21.15.47:0/1128416185 learned_addr learned my addr 172.21.15.47:0/1128416185 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.654+0000 7f4eae401700 1 -- 172.21.15.47:0/1128416185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea81030f0 con 0x7f4ea8105200 2024-04-06T03:29:16.368 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.655+0000 7f4eae401700 1 --2- 172.21.15.47:0/1128416185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8102bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4009870 tx=0x7f4ea4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.655+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ea4003af0 con 0x7f4ea8105200 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.655+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f4ea401a8e0 con 0x7f4ea8105200 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.655+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea81012e0 con 0x7f4ea8105200 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.655+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ea4024940 con 0x7f4ea8105200 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.655+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea8101820 con 0x7f4ea8105200 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.656+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 9) ==== 46093+0+0 (secure 0 0 0) 0x7f4ea4022020 con 0x7f4ea8105200 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.656+0000 7f4e9f7fe700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 0x7f4e9403b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.656+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 --> v2:172.21.15.47:6800/4248661693 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4ea4003af0 con 0x7f4e94039000 2024-04-06T03:29:16.369 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.656+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f4ea404d080 con 0x7f4ea8105200 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.656+0000 7f4eadc00700 1 -- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 msgr2=0x7f4e9403b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/4248661693 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.656+0000 7f4eadc00700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 0x7f4e9403b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.857+0000 7f4eadc00700 1 -- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 msgr2=0x7f4e9403b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/4248661693 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:09.857+0000 7f4eadc00700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 0x7f4e9403b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:10.258+0000 7f4eadc00700 1 -- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 msgr2=0x7f4e9403b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/4248661693 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:10.258+0000 7f4eadc00700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 0x7f4e9403b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:11.059+0000 7f4eadc00700 1 -- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 msgr2=0x7f4e9403b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/4248661693 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:11.059+0000 7f4eadc00700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 0x7f4e9403b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:12.660+0000 7f4eadc00700 1 -- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 msgr2=0x7f4e9403b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/4248661693 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:12.660+0000 7f4eadc00700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 0x7f4e9403b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:14.433+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mgrmap(e 10) ==== 45895+0+0 (secure 0 0 0) 0x7f4ea402daa0 con 0x7f4ea8105200 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:14.433+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 msgr2=0x7f4e9403b4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:29:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:14.433+0000 7f4e9f7fe700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 0x7f4e9403b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.434+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 11) ==== 45987+0+0 (secure 0 0 0) 0x7f4ea404ec30 con 0x7f4ea8105200 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.435+0000 7f4e9f7fe700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/850698093 conn(0x7f4e9403c8a0 0x7f4e9403ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.435+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 --> v2:172.21.15.47:6800/850698093 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4ea4025e70 con 0x7f4e9403c8a0 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.435+0000 7f4eadc00700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/850698093 conn(0x7f4e9403c8a0 0x7f4e9403ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.435+0000 7f4eadc00700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/850698093 conn(0x7f4e9403c8a0 0x7f4e9403ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4e98003a10 tx=0x7f4e98009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.436+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f4ea4025e70 con 0x7f4e9403c8a0 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 --> v2:172.21.15.47:6800/850698093 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4ea8109930 con 0x7f4e9403c8a0 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4e9f7fe700 1 -- 172.21.15.47:0/1128416185 <== mgr.14152 v2:172.21.15.47:6800/850698093 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f4ea8109930 con 0x7f4e9403c8a0 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/850698093 conn(0x7f4e9403c8a0 msgr2=0x7f4e9403ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/850698093 conn(0x7f4e9403c8a0 0x7f4e9403ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4e98003a10 tx=0x7f4e98009270 comp rx=0 tx=0).stop 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 msgr2=0x7f4ea8102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 --2- 172.21.15.47:0/1128416185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8102bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4009870 tx=0x7f4ea4011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 shutdown_connections 2024-04-06T03:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/850698093 conn(0x7f4e9403c8a0 0x7f4e9403ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:16.372 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 --2- 172.21.15.47:0/1128416185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea8105200 0x7f4ea8102bb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:16.372 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 --2- 172.21.15.47:0/1128416185 >> v2:172.21.15.47:6800/4248661693 conn(0x7f4e94039000 0x7f4e9403b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:16.372 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.443+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 >> 172.21.15.47:0/1128416185 conn(0x7f4ea8100820 msgr2=0x7f4ea8190d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:16.372 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.444+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 shutdown_connections 2024-04-06T03:29:16.372 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:15.444+0000 7f4eb0665700 1 -- 172.21.15.47:0/1128416185 wait complete. 2024-04-06T03:29:16.372 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 9 is available 2024-04-06T03:29:16.372 INFO:teuthology.orchestra.run.smithi047.stdout:Generating a dashboard self-signed certificate... 2024-04-06T03:29:17.371 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:17.371 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:17.371 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:17.639 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.770+0000 7fede582e700 1 Processor -- start 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.770+0000 7fede582e700 1 -- start start 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.771+0000 7fede582e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede0107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.771+0000 7fede582e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fede0105f60 con 0x7fede0107a20 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.771+0000 7feddeffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede0107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.771+0000 7feddeffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede0107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46144/0 (socket says 172.21.15.47:46144) 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.771+0000 7feddeffd700 1 -- 172.21.15.47:0/3437950785 learned_addr learned my addr 172.21.15.47:0/3437950785 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.771+0000 7feddeffd700 1 -- 172.21.15.47:0/3437950785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede01060e0 con 0x7fede0107a20 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.771+0000 7feddeffd700 1 --2- 172.21.15.47:0/3437950785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede0107e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fedd40098a0 tx=0x7fedd4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acef746485c9d121 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fedddffb700 1 -- 172.21.15.47:0/3437950785 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd4004160 con 0x7fede0107a20 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fedddffb700 1 -- 172.21.15.47:0/3437950785 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fedd4004300 con 0x7fede0107a20 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fedddffb700 1 -- 172.21.15.47:0/3437950785 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd4011a00 con 0x7fede0107a20 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fede582e700 1 -- 172.21.15.47:0/3437950785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 msgr2=0x7fede0107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:17.640 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fede582e700 1 --2- 172.21.15.47:0/3437950785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede0107e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fedd40098a0 tx=0x7fedd4009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fede582e700 1 -- 172.21.15.47:0/3437950785 shutdown_connections 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fede582e700 1 --2- 172.21.15.47:0/3437950785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede0107e40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fede582e700 1 -- 172.21.15.47:0/3437950785 >> 172.21.15.47:0/3437950785 conn(0x7fede01018c0 msgr2=0x7fede0103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fede582e700 1 -- 172.21.15.47:0/3437950785 shutdown_connections 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.772+0000 7fede582e700 1 -- 172.21.15.47:0/3437950785 wait complete. 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.773+0000 7fede582e700 1 Processor -- start 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.773+0000 7fede582e700 1 -- start start 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.773+0000 7fede582e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.773+0000 7fede582e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fede010a8f0 con 0x7fede0107a20 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.773+0000 7feddeffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.773+0000 7feddeffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46150/0 (socket says 172.21.15.47:46150) 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.773+0000 7feddeffd700 1 -- 172.21.15.47:0/2698340216 learned_addr learned my addr 172.21.15.47:0/2698340216 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.774+0000 7feddeffd700 1 -- 172.21.15.47:0/2698340216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede019a7b0 con 0x7fede0107a20 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.774+0000 7feddeffd700 1 --2- 172.21.15.47:0/2698340216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede019a270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009fb0 tx=0x7fedd4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.774+0000 7fede482c700 1 -- 172.21.15.47:0/2698340216 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd401a430 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.774+0000 7fede482c700 1 -- 172.21.15.47:0/2698340216 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fedd401aa80 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.774+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede019aa40 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.774+0000 7fede482c700 1 -- 172.21.15.47:0/2698340216 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd40249b0 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.774+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede019d730 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.775+0000 7fede482c700 1 -- 172.21.15.47:0/2698340216 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 11) ==== 45987+0+0 (secure 0 0 0) 0x7fedd4022020 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.775+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede0063900 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.775+0000 7fede482c700 1 --2- 172.21.15.47:0/2698340216 >> v2:172.21.15.47:6800/850698093 conn(0x7fedc8038cb0 0x7fedc803b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.775+0000 7fede482c700 1 -- 172.21.15.47:0/2698340216 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fedd404d470 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.775+0000 7fedde7fc700 1 --2- 172.21.15.47:0/2698340216 >> v2:172.21.15.47:6800/850698093 conn(0x7fedc8038cb0 0x7fedc803b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.776+0000 7fedde7fc700 1 --2- 172.21.15.47:0/2698340216 >> v2:172.21.15.47:6800/850698093 conn(0x7fedc8038cb0 0x7fedc803b170 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006fd0 tx=0x7fedd0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.780+0000 7fede482c700 1 -- 172.21.15.47:0/2698340216 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fedd400b3e0 con 0x7fede0107a20 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:16.992+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fede0102a40 con 0x7fedc8038cb0 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.047+0000 7fede482c700 1 -- 172.21.15.47:0/2698340216 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fede0102a40 con 0x7fedc8038cb0 2024-04-06T03:29:17.642 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.050+0000 7fede482c700 1 -- 172.21.15.47:0/2698340216 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 12) ==== 46093+0+0 (secure 0 0 0) 0x7fedd402d3f0 con 0x7fede0107a20 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 >> v2:172.21.15.47:6800/850698093 conn(0x7fedc8038cb0 msgr2=0x7fedc803b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 --2- 172.21.15.47:0/2698340216 >> v2:172.21.15.47:6800/850698093 conn(0x7fedc8038cb0 0x7fedc803b170 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006fd0 tx=0x7fedd0006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 msgr2=0x7fede019a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 --2- 172.21.15.47:0/2698340216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede019a270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009fb0 tx=0x7fedd4011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 shutdown_connections 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 --2- 172.21.15.47:0/2698340216 >> v2:172.21.15.47:6800/850698093 conn(0x7fedc8038cb0 0x7fedc803b170 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 --2- 172.21.15.47:0/2698340216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0107a20 0x7fede019a270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 >> 172.21.15.47:0/2698340216 conn(0x7fede01018c0 msgr2=0x7fede0102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 shutdown_connections 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:17.051+0000 7fede582e700 1 -- 172.21.15.47:0/2698340216 wait complete. 2024-04-06T03:29:17.643 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial admin user... 2024-04-06T03:29:18.241 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:18 smithi047 ceph-mon[29365]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:18.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:18 smithi047 ceph-mon[29365]: mgrmap e12: y(active, since 2s) 2024-04-06T03:29:18.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:19.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:19 smithi047 ceph-mon[29365]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:19.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$vKZGa3T.kWUQ8O4vPl.oke4Zv/k93rwRplr7yzqEkt5VDehbAuQHC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1712374158, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.090+0000 7f265ce1b700 1 Processor -- start 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.090+0000 7f265ce1b700 1 -- start start 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.090+0000 7f265ce1b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265807a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.090+0000 7f265ce1b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f265807a9e0 con 0x7f265807bfb0 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.090+0000 7f265659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265807a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.090+0000 7f265659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265807a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46158/0 (socket says 172.21.15.47:46158) 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.090+0000 7f265659c700 1 -- 172.21.15.47:0/917422497 learned_addr learned my addr 172.21.15.47:0/917422497 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.090+0000 7f265659c700 1 -- 172.21.15.47:0/917422497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265807ab60 con 0x7f265807bfb0 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.091+0000 7f265659c700 1 --2- 172.21.15.47:0/917422497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265807a410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26480098a0 tx=0x7f2648009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e51669bab277c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:19.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.091+0000 7f265559a700 1 -- 172.21.15.47:0/917422497 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2648004160 con 0x7f265807bfb0 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.091+0000 7f265559a700 1 -- 172.21.15.47:0/917422497 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f2648004300 con 0x7f265807bfb0 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.091+0000 7f265559a700 1 -- 172.21.15.47:0/917422497 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2648011a00 con 0x7f265807bfb0 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.091+0000 7f265ce1b700 1 -- 172.21.15.47:0/917422497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 msgr2=0x7f265807a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.091+0000 7f265ce1b700 1 --2- 172.21.15.47:0/917422497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265807a410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26480098a0 tx=0x7f2648009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 -- 172.21.15.47:0/917422497 shutdown_connections 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 --2- 172.21.15.47:0/917422497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265807a410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 -- 172.21.15.47:0/917422497 >> 172.21.15.47:0/917422497 conn(0x7f26581018f0 msgr2=0x7f2658103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 -- 172.21.15.47:0/917422497 shutdown_connections 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 -- 172.21.15.47:0/917422497 wait complete. 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 Processor -- start 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 -- start start 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265819c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.092+0000 7f265ce1b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f265810c930 con 0x7f265807bfb0 2024-04-06T03:29:19.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f265659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265819c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f265659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265819c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46174/0 (socket says 172.21.15.47:46174) 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f265659c700 1 -- 172.21.15.47:0/731196760 learned_addr learned my addr 172.21.15.47:0/731196760 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f265659c700 1 -- 172.21.15.47:0/731196760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265819c990 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f265659c700 1 --2- 172.21.15.47:0/731196760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265819c450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2648009fb0 tx=0x7f2648011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f264f7fe700 1 -- 172.21.15.47:0/731196760 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2648003aa0 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f264f7fe700 1 -- 172.21.15.47:0/731196760 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f264801a8e0 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265819cc20 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f264f7fe700 1 -- 172.21.15.47:0/731196760 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2648024930 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.093+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f265819f910 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.094+0000 7f264f7fe700 1 -- 172.21.15.47:0/731196760 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 12) ==== 46093+0+0 (secure 0 0 0) 0x7f2648022020 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.094+0000 7f264f7fe700 1 --2- 172.21.15.47:0/731196760 >> v2:172.21.15.47:6800/850698093 conn(0x7f2644038dc0 0x7f264403b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.094+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2658063900 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.095+0000 7f264f7fe700 1 -- 172.21.15.47:0/731196760 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f264804d560 con 0x7f265807bfb0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.095+0000 7f2655d9b700 1 --2- 172.21.15.47:0/731196760 >> v2:172.21.15.47:6800/850698093 conn(0x7f2644038dc0 0x7f264403b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:19.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.095+0000 7f2655d9b700 1 --2- 172.21.15.47:0/731196760 >> v2:172.21.15.47:6800/850698093 conn(0x7f2644038dc0 0x7f264403b280 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2640006fd0 tx=0x7f2640006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.100+0000 7f264f7fe700 1 -- 172.21.15.47:0/731196760 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f264800b3e0 con 0x7f265807bfb0 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.327+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f2658102af0 con 0x7f2644038dc0 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.574+0000 7f264f7fe700 1 -- 172.21.15.47:0/731196760 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f2658102af0 con 0x7f2644038dc0 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 >> v2:172.21.15.47:6800/850698093 conn(0x7f2644038dc0 msgr2=0x7f264403b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 --2- 172.21.15.47:0/731196760 >> v2:172.21.15.47:6800/850698093 conn(0x7f2644038dc0 0x7f264403b280 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2640006fd0 tx=0x7f2640006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 msgr2=0x7f265819c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 --2- 172.21.15.47:0/731196760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265819c450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2648009fb0 tx=0x7f2648011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 shutdown_connections 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 --2- 172.21.15.47:0/731196760 >> v2:172.21.15.47:6800/850698093 conn(0x7f2644038dc0 0x7f264403b280 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 --2- 172.21.15.47:0/731196760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265807bfb0 0x7f265819c450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 >> 172.21.15.47:0/731196760 conn(0x7f26581018f0 msgr2=0x7f26581023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 shutdown_connections 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:18.576+0000 7f265ce1b700 1 -- 172.21.15.47:0/731196760 wait complete. 2024-04-06T03:29:19.813 INFO:teuthology.orchestra.run.smithi047.stdout:Fetching dashboard port number... 2024-04-06T03:29:20.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3839390734' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-06T03:29:21.024 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 8443 2024-04-06T03:29:21.024 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4196f0f700 1 Processor -- start 2024-04-06T03:29:21.024 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4196f0f700 1 -- start start 2024-04-06T03:29:21.024 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4196f0f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f4190107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:21.024 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4196f0f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4190105f60 con 0x7f4190107a20 2024-04-06T03:29:21.024 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4194cab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f4190107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:21.024 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4194cab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f4190107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46182/0 (socket says 172.21.15.47:46182) 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4194cab700 1 -- 172.21.15.47:0/1178038807 learned_addr learned my addr 172.21.15.47:0/1178038807 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4194cab700 1 -- 172.21.15.47:0/1178038807 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41901060e0 con 0x7f4190107a20 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.239+0000 7f4194cab700 1 --2- 172.21.15.47:0/1178038807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f4190107e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41840098a0 tx=0x7f4184009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74a47f09e4c39ee server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f418f7fe700 1 -- 172.21.15.47:0/1178038807 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4184004160 con 0x7f4190107a20 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f418f7fe700 1 -- 172.21.15.47:0/1178038807 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f4184004300 con 0x7f4190107a20 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f418f7fe700 1 -- 172.21.15.47:0/1178038807 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4184011a00 con 0x7f4190107a20 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f4196f0f700 1 -- 172.21.15.47:0/1178038807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 msgr2=0x7f4190107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f4196f0f700 1 --2- 172.21.15.47:0/1178038807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f4190107e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41840098a0 tx=0x7f4184009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f4196f0f700 1 -- 172.21.15.47:0/1178038807 shutdown_connections 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f4196f0f700 1 --2- 172.21.15.47:0/1178038807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f4190107e40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f4196f0f700 1 -- 172.21.15.47:0/1178038807 >> 172.21.15.47:0/1178038807 conn(0x7f41901018c0 msgr2=0x7f4190103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f4196f0f700 1 -- 172.21.15.47:0/1178038807 shutdown_connections 2024-04-06T03:29:21.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.240+0000 7f4196f0f700 1 -- 172.21.15.47:0/1178038807 wait complete. 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.241+0000 7f4196f0f700 1 Processor -- start 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.241+0000 7f4196f0f700 1 -- start start 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.241+0000 7f4196f0f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f419019c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.241+0000 7f4196f0f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f419010a8f0 con 0x7f4190107a20 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.241+0000 7f4194cab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f419019c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.241+0000 7f4194cab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f419019c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46186/0 (socket says 172.21.15.47:46186) 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.241+0000 7f4194cab700 1 -- 172.21.15.47:0/3839390734 learned_addr learned my addr 172.21.15.47:0/3839390734 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.241+0000 7f4194cab700 1 -- 172.21.15.47:0/3839390734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419019c9e0 con 0x7f4190107a20 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.242+0000 7f4194cab700 1 --2- 172.21.15.47:0/3839390734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f419019c4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fb0 tx=0x7f4184011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.242+0000 7f418dffb700 1 -- 172.21.15.47:0/3839390734 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418401a430 con 0x7f4190107a20 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.242+0000 7f418dffb700 1 -- 172.21.15.47:0/3839390734 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f418401aa80 con 0x7f4190107a20 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.242+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419019cc70 con 0x7f4190107a20 2024-04-06T03:29:21.026 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.242+0000 7f418dffb700 1 -- 172.21.15.47:0/3839390734 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41840249b0 con 0x7f4190107a20 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.242+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419019f960 con 0x7f4190107a20 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.243+0000 7f418dffb700 1 -- 172.21.15.47:0/3839390734 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 12) ==== 46093+0+0 (secure 0 0 0) 0x7f4184022020 con 0x7f4190107a20 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.243+0000 7f418dffb700 1 --2- 172.21.15.47:0/3839390734 >> v2:172.21.15.47:6800/850698093 conn(0x7f4180038e10 0x7f418003b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.243+0000 7f418dffb700 1 -- 172.21.15.47:0/3839390734 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f418404d540 con 0x7f4190107a20 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.243+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4190063900 con 0x7f4190107a20 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.243+0000 7f418ffff700 1 --2- 172.21.15.47:0/3839390734 >> v2:172.21.15.47:6800/850698093 conn(0x7f4180038e10 0x7f418003b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.243+0000 7f418ffff700 1 --2- 172.21.15.47:0/3839390734 >> v2:172.21.15.47:6800/850698093 conn(0x7f4180038e10 0x7f418003b2d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f417c006fd0 tx=0x7f417c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.248+0000 7f418dffb700 1 -- 172.21.15.47:0/3839390734 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f418400b3e0 con 0x7f4190107a20 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.447+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f419019fb30 con 0x7f4190107a20 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.448+0000 7f418dffb700 1 -- 172.21.15.47:0/3839390734 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f41840172b0 con 0x7f4190107a20 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 >> v2:172.21.15.47:6800/850698093 conn(0x7f4180038e10 msgr2=0x7f418003b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 --2- 172.21.15.47:0/3839390734 >> v2:172.21.15.47:6800/850698093 conn(0x7f4180038e10 0x7f418003b2d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f417c006fd0 tx=0x7f417c006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 msgr2=0x7f419019c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:21.027 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 --2- 172.21.15.47:0/3839390734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f419019c4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fb0 tx=0x7f4184011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:21.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 shutdown_connections 2024-04-06T03:29:21.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 --2- 172.21.15.47:0/3839390734 >> v2:172.21.15.47:6800/850698093 conn(0x7f4180038e10 0x7f418003b2d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:21.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 --2- 172.21.15.47:0/3839390734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4190107a20 0x7f419019c4a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:21.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 >> 172.21.15.47:0/3839390734 conn(0x7f41901018c0 msgr2=0x7f41901022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:21.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 shutdown_connections 2024-04-06T03:29:21.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:20.450+0000 7f4196f0f700 1 -- 172.21.15.47:0/3839390734 wait complete. 2024-04-06T03:29:21.031 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-06T03:29:21.031 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-04-06T03:29:21.038 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-06T03:29:21.038 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-04-06T03:29:21.038 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-04-06T03:29:21.038 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-06T03:29:21.040 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph Dashboard is now available at: 2024-04-06T03:29:21.040 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:21.040 INFO:teuthology.orchestra.run.smithi047.stdout: URL: https://smithi047.front.sepia.ceph.com:8443/ 2024-04-06T03:29:21.040 INFO:teuthology.orchestra.run.smithi047.stdout: User: admin 2024-04-06T03:29:21.040 INFO:teuthology.orchestra.run.smithi047.stdout: Password: zxqsj11xsa 2024-04-06T03:29:21.040 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:21.040 INFO:teuthology.orchestra.run.smithi047.stdout:Saving cluster configuration to /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config directory 2024-04-06T03:29:21.041 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling autotune for osd_memory_target 2024-04-06T03:29:21.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:21 smithi047 ceph-mon[29365]: mgrmap e13: y(active, since 6s) 2024-04-06T03:29:22.339 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.458+0000 7fc64a1cb700 1 Processor -- start 2024-04-06T03:29:22.339 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.458+0000 7fc64a1cb700 1 -- start start 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.458+0000 7fc64a1cb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644106d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.458+0000 7fc64a1cb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc644104e70 con 0x7fc644106930 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.459+0000 7fc6437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.459+0000 7fc6437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46194/0 (socket says 172.21.15.47:46194) 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.459+0000 7fc6437fe700 1 -- 172.21.15.47:0/164251917 learned_addr learned my addr 172.21.15.47:0/164251917 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.459+0000 7fc6437fe700 1 -- 172.21.15.47:0/164251917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc644104ff0 con 0x7fc644106930 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.459+0000 7fc6437fe700 1 --2- 172.21.15.47:0/164251917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644106d50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6340098a0 tx=0x7fc634009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771bee49b90481d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.459+0000 7fc6427fc700 1 -- 172.21.15.47:0/164251917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc634004160 con 0x7fc644106930 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.459+0000 7fc6427fc700 1 -- 172.21.15.47:0/164251917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc634004300 con 0x7fc644106930 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.459+0000 7fc6427fc700 1 -- 172.21.15.47:0/164251917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc634011a00 con 0x7fc644106930 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.460+0000 7fc64a1cb700 1 -- 172.21.15.47:0/164251917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 msgr2=0x7fc644106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.460+0000 7fc64a1cb700 1 --2- 172.21.15.47:0/164251917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644106d50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6340098a0 tx=0x7fc634009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:22.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.460+0000 7fc64a1cb700 1 -- 172.21.15.47:0/164251917 shutdown_connections 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.460+0000 7fc64a1cb700 1 --2- 172.21.15.47:0/164251917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644106d50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.460+0000 7fc64a1cb700 1 -- 172.21.15.47:0/164251917 >> 172.21.15.47:0/164251917 conn(0x7fc644100870 msgr2=0x7fc644102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.460+0000 7fc64a1cb700 1 -- 172.21.15.47:0/164251917 shutdown_connections 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.460+0000 7fc64a1cb700 1 -- 172.21.15.47:0/164251917 wait complete. 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc64a1cb700 1 Processor -- start 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc64a1cb700 1 -- start start 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc64a1cb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc64a1cb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc6440789d0 con 0x7fc644106930 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc6437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc6437fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46198/0 (socket says 172.21.15.47:46198) 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc6437fe700 1 -- 172.21.15.47:0/4054256380 learned_addr learned my addr 172.21.15.47:0/4054256380 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc6437fe700 1 -- 172.21.15.47:0/4054256380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6441985d0 con 0x7fc644106930 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.461+0000 7fc6437fe700 1 --2- 172.21.15.47:0/4054256380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644198090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc634009fb0 tx=0x7fc634011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.462+0000 7fc640ff9700 1 -- 172.21.15.47:0/4054256380 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc63401a430 con 0x7fc644106930 2024-04-06T03:29:22.341 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.462+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc644198860 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.462+0000 7fc640ff9700 1 -- 172.21.15.47:0/4054256380 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc63401aa80 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.462+0000 7fc640ff9700 1 -- 172.21.15.47:0/4054256380 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6340249b0 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.462+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64419b550 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.462+0000 7fc640ff9700 1 -- 172.21.15.47:0/4054256380 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7fc634022020 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.463+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc644063900 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.463+0000 7fc640ff9700 1 --2- 172.21.15.47:0/4054256380 >> v2:172.21.15.47:6800/850698093 conn(0x7fc62c03b070 0x7fc62c03d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.463+0000 7fc640ff9700 1 -- 172.21.15.47:0/4054256380 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fc63404d700 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.463+0000 7fc642ffd700 1 --2- 172.21.15.47:0/4054256380 >> v2:172.21.15.47:6800/850698093 conn(0x7fc62c03b070 0x7fc62c03d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.463+0000 7fc642ffd700 1 --2- 172.21.15.47:0/4054256380 >> v2:172.21.15.47:6800/850698093 conn(0x7fc62c03b070 0x7fc62c03d530 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc638006fd0 tx=0x7fc638006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.468+0000 7fc640ff9700 1 -- 172.21.15.47:0/4054256380 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc63402d4b0 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.671+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fc6441915f0 con 0x7fc644106930 2024-04-06T03:29:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.671+0000 7fc640ff9700 1 -- 172.21.15.47:0/4054256380 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fc63402d770 con 0x7fc644106930 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.673+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 >> v2:172.21.15.47:6800/850698093 conn(0x7fc62c03b070 msgr2=0x7fc62c03d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.673+0000 7fc64a1cb700 1 --2- 172.21.15.47:0/4054256380 >> v2:172.21.15.47:6800/850698093 conn(0x7fc62c03b070 0x7fc62c03d530 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc638006fd0 tx=0x7fc638006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.673+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 msgr2=0x7fc644198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.673+0000 7fc64a1cb700 1 --2- 172.21.15.47:0/4054256380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644198090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc634009fb0 tx=0x7fc634011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.674+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 shutdown_connections 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.674+0000 7fc64a1cb700 1 --2- 172.21.15.47:0/4054256380 >> v2:172.21.15.47:6800/850698093 conn(0x7fc62c03b070 0x7fc62c03d530 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.674+0000 7fc64a1cb700 1 --2- 172.21.15.47:0/4054256380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644106930 0x7fc644198090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.674+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 >> 172.21.15.47:0/4054256380 conn(0x7fc644100870 msgr2=0x7fc64418e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.674+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 shutdown_connections 2024-04-06T03:29:22.343 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:21.674+0000 7fc64a1cb700 1 -- 172.21.15.47:0/4054256380 wait complete. 2024-04-06T03:29:23.671 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.759+0000 7f5790a4f700 1 Processor -- start 2024-04-06T03:29:23.671 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.759+0000 7f5790a4f700 1 -- start start 2024-04-06T03:29:23.671 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.759+0000 7f5790a4f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:23.671 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.759+0000 7f5790a4f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f578c105f60 con 0x7f578c107a20 2024-04-06T03:29:23.671 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.759+0000 7f578a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:23.671 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.759+0000 7f578a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46214/0 (socket says 172.21.15.47:46214) 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.759+0000 7f578a59c700 1 -- 172.21.15.47:0/1169741391 learned_addr learned my addr 172.21.15.47:0/1169741391 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.760+0000 7f578a59c700 1 -- 172.21.15.47:0/1169741391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c1060e0 con 0x7f578c107a20 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.760+0000 7f578a59c700 1 --2- 172.21.15.47:0/1169741391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c107e40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f577c0098a0 tx=0x7f577c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc89fc3c9bf8ef38 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.760+0000 7f578959a700 1 -- 172.21.15.47:0/1169741391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c004160 con 0x7f578c107a20 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.760+0000 7f578959a700 1 -- 172.21.15.47:0/1169741391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f577c004300 con 0x7f578c107a20 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.760+0000 7f578959a700 1 -- 172.21.15.47:0/1169741391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c011a00 con 0x7f578c107a20 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.761+0000 7f5790a4f700 1 -- 172.21.15.47:0/1169741391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 msgr2=0x7f578c107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.761+0000 7f5790a4f700 1 --2- 172.21.15.47:0/1169741391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c107e40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f577c0098a0 tx=0x7f577c009bb0 comp rx=0 tx=0).stop 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.761+0000 7f5790a4f700 1 -- 172.21.15.47:0/1169741391 shutdown_connections 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.761+0000 7f5790a4f700 1 --2- 172.21.15.47:0/1169741391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c107e40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.761+0000 7f5790a4f700 1 -- 172.21.15.47:0/1169741391 >> 172.21.15.47:0/1169741391 conn(0x7f578c1018c0 msgr2=0x7f578c103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.761+0000 7f5790a4f700 1 -- 172.21.15.47:0/1169741391 shutdown_connections 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.761+0000 7f5790a4f700 1 -- 172.21.15.47:0/1169741391 wait complete. 2024-04-06T03:29:23.672 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f5790a4f700 1 Processor -- start 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f5790a4f700 1 -- start start 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f5790a4f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c07bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f5790a4f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f578c10a8f0 con 0x7f578c107a20 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f578a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c07bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f578a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c07bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46224/0 (socket says 172.21.15.47:46224) 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f578a59c700 1 -- 172.21.15.47:0/1784501890 learned_addr learned my addr 172.21.15.47:0/1784501890 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f578a59c700 1 -- 172.21.15.47:0/1784501890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c07c1c0 con 0x7f578c107a20 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f578a59c700 1 --2- 172.21.15.47:0/1784501890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c07bc80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f577c009fb0 tx=0x7f577c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f577b7fe700 1 -- 172.21.15.47:0/1784501890 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c01a430 con 0x7f578c107a20 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f577b7fe700 1 -- 172.21.15.47:0/1784501890 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f577c01aa80 con 0x7f578c107a20 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.762+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578c07a3b0 con 0x7f578c107a20 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.763+0000 7f577b7fe700 1 -- 172.21.15.47:0/1784501890 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c0249b0 con 0x7f578c107a20 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.763+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578c07a8f0 con 0x7f578c107a20 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.763+0000 7f577b7fe700 1 -- 172.21.15.47:0/1784501890 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7f577c022020 con 0x7f578c107a20 2024-04-06T03:29:23.673 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.763+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578c063900 con 0x7f578c107a20 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.764+0000 7f577b7fe700 1 --2- 172.21.15.47:0/1784501890 >> v2:172.21.15.47:6800/850698093 conn(0x7f5774038e60 0x7f577403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.764+0000 7f577b7fe700 1 -- 172.21.15.47:0/1784501890 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f577c04d630 con 0x7f578c107a20 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.764+0000 7f5789d9b700 1 --2- 172.21.15.47:0/1784501890 >> v2:172.21.15.47:6800/850698093 conn(0x7f5774038e60 0x7f577403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.764+0000 7f5789d9b700 1 --2- 172.21.15.47:0/1784501890 >> v2:172.21.15.47:6800/850698093 conn(0x7f5774038e60 0x7f577403b320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5780006fd0 tx=0x7f5780006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:22.769+0000 7f577b7fe700 1 -- 172.21.15.47:0/1784501890 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f577c00f2e0 con 0x7f578c107a20 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.084+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f578c07ad70 con 0x7f578c107a20 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.087+0000 7f577b7fe700 1 -- 172.21.15.47:0/1784501890 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f577c02d3f0 con 0x7f578c107a20 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 >> v2:172.21.15.47:6800/850698093 conn(0x7f5774038e60 msgr2=0x7f577403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 --2- 172.21.15.47:0/1784501890 >> v2:172.21.15.47:6800/850698093 conn(0x7f5774038e60 0x7f577403b320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5780006fd0 tx=0x7f5780006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 msgr2=0x7f578c07bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 --2- 172.21.15.47:0/1784501890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c07bc80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f577c009fb0 tx=0x7f577c011ac0 comp rx=0 tx=0).stop 2024-04-06T03:29:23.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 shutdown_connections 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 --2- 172.21.15.47:0/1784501890 >> v2:172.21.15.47:6800/850698093 conn(0x7f5774038e60 0x7f577403b320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 --2- 172.21.15.47:0/1784501890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f578c107a20 0x7f578c07bc80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 >> 172.21.15.47:0/1784501890 conn(0x7f578c1018c0 msgr2=0x7f578c102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 shutdown_connections 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-04-06T03:29:23.089+0000 7f5790a4f700 1 -- 172.21.15.47:0/1784501890 wait complete. 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /sbin/cephadm shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:Or, if you are only running a single cluster on this host: 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /sbin/cephadm shell 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-06T03:29:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: ceph telemetry on 2024-04-06T03:29:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:23.676 INFO:teuthology.orchestra.run.smithi047.stdout:For more information see: 2024-04-06T03:29:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-06T03:29:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:23.676 INFO:teuthology.orchestra.run.smithi047.stdout:Bootstrap complete. 2024-04-06T03:29:23.715 INFO:tasks.cephadm:Fetching config... 2024-04-06T03:29:23.715 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:29:23.715 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-06T03:29:23.732 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-06T03:29:23.732 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:29:23.732 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-06T03:29:23.787 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-06T03:29:23.787 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:29:23.787 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/keyring of=/dev/stdout 2024-04-06T03:29:23.854 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-06T03:29:23.854 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:29:23.854 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-06T03:29:23.910 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-06T03:29:23.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDz6U2tH3PxCkHxixCqZQCH8qRw0+wDm0/nSB9TW9M0Xss2T0d+2qUPZXNPcJmOVtM7bl4oLIwgbbwJt+nsOfFhT2EZAUZp2ygEYaoy8GxOU6csI4L9vHZzujqhq7Lvs2jjOw8q+ujmVl58NGAzf4kXqbnFWslyw3CtO7ojlgbOyBznpAgpxl41iO77uz3RtgcW8uy04vBEjyUZwdIV46Pq7i71uNmrqpAJ1YxsadmXMmuOdH1oCOE+c6/WVOMr96qWSsQqIuKLoskv+wDrJqg6xzk8Yh735uwcgMTPnOfXySB/PqsKpi28rSh7G+B2C8ww6ANUL1bLNn2mxYrKs9v+t5/7TYUgmU7ootojX/lFPY4Hd3ORoRq6bn1tFSvLgwdTxcavIMcKMK6Ff+mVDX3xKBIHpyi3ohtqPeRdW+M/Pom9IRB+miBSsblpN1ydRSYU1JXKWETiD33V4TcOh1F45aHJ4uDaEssDyts/SCz20Zwl6E+8h1qU1ZlcCO814dk= ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-06T03:29:23.988 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDz6U2tH3PxCkHxixCqZQCH8qRw0+wDm0/nSB9TW9M0Xss2T0d+2qUPZXNPcJmOVtM7bl4oLIwgbbwJt+nsOfFhT2EZAUZp2ygEYaoy8GxOU6csI4L9vHZzujqhq7Lvs2jjOw8q+ujmVl58NGAzf4kXqbnFWslyw3CtO7ojlgbOyBznpAgpxl41iO77uz3RtgcW8uy04vBEjyUZwdIV46Pq7i71uNmrqpAJ1YxsadmXMmuOdH1oCOE+c6/WVOMr96qWSsQqIuKLoskv+wDrJqg6xzk8Yh735uwcgMTPnOfXySB/PqsKpi28rSh7G+B2C8ww6ANUL1bLNn2mxYrKs9v+t5/7TYUgmU7ootojX/lFPY4Hd3ORoRq6bn1tFSvLgwdTxcavIMcKMK6Ff+mVDX3xKBIHpyi3ohtqPeRdW+M/Pom9IRB+miBSsblpN1ydRSYU1JXKWETiD33V4TcOh1F45aHJ4uDaEssDyts/SCz20Zwl6E+8h1qU1ZlcCO814dk= ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:24.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDz6U2tH3PxCkHxixCqZQCH8qRw0+wDm0/nSB9TW9M0Xss2T0d+2qUPZXNPcJmOVtM7bl4oLIwgbbwJt+nsOfFhT2EZAUZp2ygEYaoy8GxOU6csI4L9vHZzujqhq7Lvs2jjOw8q+ujmVl58NGAzf4kXqbnFWslyw3CtO7ojlgbOyBznpAgpxl41iO77uz3RtgcW8uy04vBEjyUZwdIV46Pq7i71uNmrqpAJ1YxsadmXMmuOdH1oCOE+c6/WVOMr96qWSsQqIuKLoskv+wDrJqg6xzk8Yh735uwcgMTPnOfXySB/PqsKpi28rSh7G+B2C8ww6ANUL1bLNn2mxYrKs9v+t5/7TYUgmU7ootojX/lFPY4Hd3ORoRq6bn1tFSvLgwdTxcavIMcKMK6Ff+mVDX3xKBIHpyi3ohtqPeRdW+M/Pom9IRB+miBSsblpN1ydRSYU1JXKWETiD33V4TcOh1F45aHJ4uDaEssDyts/SCz20Zwl6E+8h1qU1ZlcCO814dk= ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-06T03:29:24.049 INFO:teuthology.orchestra.run.smithi102.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDz6U2tH3PxCkHxixCqZQCH8qRw0+wDm0/nSB9TW9M0Xss2T0d+2qUPZXNPcJmOVtM7bl4oLIwgbbwJt+nsOfFhT2EZAUZp2ygEYaoy8GxOU6csI4L9vHZzujqhq7Lvs2jjOw8q+ujmVl58NGAzf4kXqbnFWslyw3CtO7ojlgbOyBznpAgpxl41iO77uz3RtgcW8uy04vBEjyUZwdIV46Pq7i71uNmrqpAJ1YxsadmXMmuOdH1oCOE+c6/WVOMr96qWSsQqIuKLoskv+wDrJqg6xzk8Yh735uwcgMTPnOfXySB/PqsKpi28rSh7G+B2C8ww6ANUL1bLNn2mxYrKs9v+t5/7TYUgmU7ootojX/lFPY4Hd3ORoRq6bn1tFSvLgwdTxcavIMcKMK6Ff+mVDX3xKBIHpyi3ohtqPeRdW+M/Pom9IRB+miBSsblpN1ydRSYU1JXKWETiD33V4TcOh1F45aHJ4uDaEssDyts/SCz20Zwl6E+8h1qU1ZlcCO814dk= ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:24.065 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-06T03:29:24.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1784501890' entity='client.admin' 2024-04-06T03:29:24.307 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:29:26.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.510+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3725704516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 msgr2=0x7f359c102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:26.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.510+0000 7f35a3e7e700 1 --2- 172.21.15.47:0/3725704516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 0x7f359c102140 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3598009910 tx=0x7f3598009c20 comp rx=0 tx=0).stop 2024-04-06T03:29:26.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.511+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3725704516 shutdown_connections 2024-04-06T03:29:26.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.511+0000 7f35a3e7e700 1 --2- 172.21.15.47:0/3725704516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 0x7f359c102140 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.511+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3725704516 >> 172.21.15.47:0/3725704516 conn(0x7f359c0fd2c0 msgr2=0x7f359c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.511+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3725704516 shutdown_connections 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.511+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3725704516 wait complete. 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.511+0000 7f35a3e7e700 1 Processor -- start 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.511+0000 7f35a3e7e700 1 -- start start 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f35a3e7e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 0x7f359c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f35a3e7e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f359c107460 con 0x7f359c101d20 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f35a1c1a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 0x7f359c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f35a1c1a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 0x7f359c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46228/0 (socket says 172.21.15.47:46228) 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f35a1c1a700 1 -- 172.21.15.47:0/3564000606 learned_addr learned my addr 172.21.15.47:0/3564000606 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:26.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f35a1c1a700 1 -- 172.21.15.47:0/3564000606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c0764d0 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f35a1c1a700 1 --2- 172.21.15.47:0/3564000606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 0x7f359c075f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f359800b5c0 tx=0x7f35980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f3592ffd700 1 -- 172.21.15.47:0/3564000606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3598027070 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.512+0000 7f3592ffd700 1 -- 172.21.15.47:0/3564000606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f359800be10 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.513+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c0746c0 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.513+0000 7f3592ffd700 1 -- 172.21.15.47:0/3564000606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3598022e40 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.513+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c074c00 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.513+0000 7f3592ffd700 1 -- 172.21.15.47:0/3564000606 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7f359802a070 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.514+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c107be0 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.514+0000 7f3592ffd700 1 --2- 172.21.15.47:0/3564000606 >> v2:172.21.15.47:6800/850698093 conn(0x7f3588038eb0 0x7f358803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.514+0000 7f3592ffd700 1 -- 172.21.15.47:0/3564000606 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f359801e030 con 0x7f359c101d20 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.514+0000 7f35a1419700 1 --2- 172.21.15.47:0/3564000606 >> v2:172.21.15.47:6800/850698093 conn(0x7f3588038eb0 0x7f358803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:26.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.514+0000 7f35a1419700 1 --2- 172.21.15.47:0/3564000606 >> v2:172.21.15.47:6800/850698093 conn(0x7f3588038eb0 0x7f358803b370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f358c006fd0 tx=0x7f358c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:26.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.519+0000 7f3592ffd700 1 -- 172.21.15.47:0/3564000606 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3598013070 con 0x7f359c101d20 2024-04-06T03:29:26.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.725+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f359c190350 con 0x7f359c101d20 2024-04-06T03:29:26.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.727+0000 7f3592ffd700 1 -- 172.21.15.47:0/3564000606 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f359802b570 con 0x7f359c101d20 2024-04-06T03:29:26.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 >> v2:172.21.15.47:6800/850698093 conn(0x7f3588038eb0 msgr2=0x7f358803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:26.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 --2- 172.21.15.47:0/3564000606 >> v2:172.21.15.47:6800/850698093 conn(0x7f3588038eb0 0x7f358803b370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f358c006fd0 tx=0x7f358c006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:26.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 msgr2=0x7f359c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:26.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 --2- 172.21.15.47:0/3564000606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 0x7f359c075f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f359800b5c0 tx=0x7f35980046b0 comp rx=0 tx=0).stop 2024-04-06T03:29:26.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 shutdown_connections 2024-04-06T03:29:26.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 --2- 172.21.15.47:0/3564000606 >> v2:172.21.15.47:6800/850698093 conn(0x7f3588038eb0 0x7f358803b370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:26.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 --2- 172.21.15.47:0/3564000606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c101d20 0x7f359c075f90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:26.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 >> 172.21.15.47:0/3564000606 conn(0x7f359c0fd2c0 msgr2=0x7f359c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:26.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 shutdown_connections 2024-04-06T03:29:26.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:26.730+0000 7f35a3e7e700 1 -- 172.21.15.47:0/3564000606 wait complete. 2024-04-06T03:29:26.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:26.947 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:26.947 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:29:26.947 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:26.947 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:26.947 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:27.369 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-06T03:29:27.370 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-06T03:29:27.608 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:29:27.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3564000606' entity='client.admin' 2024-04-06T03:29:27.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:27 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:27.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:27 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:28.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.983+0000 7fa4c084e700 1 -- 172.21.15.47:0/1086757520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 msgr2=0x7fa4bc101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:28.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.983+0000 7fa4c084e700 1 --2- 172.21.15.47:0/1086757520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 0x7fa4bc101020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009910 tx=0x7fa4ac009c20 comp rx=0 tx=0).stop 2024-04-06T03:29:28.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.983+0000 7fa4c084e700 1 -- 172.21.15.47:0/1086757520 shutdown_connections 2024-04-06T03:29:28.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.983+0000 7fa4c084e700 1 --2- 172.21.15.47:0/1086757520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 0x7fa4bc101020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:28.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.983+0000 7fa4c084e700 1 -- 172.21.15.47:0/1086757520 >> 172.21.15.47:0/1086757520 conn(0x7fa4bc0fc1a0 msgr2=0x7fa4bc0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:28.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.983+0000 7fa4c084e700 1 -- 172.21.15.47:0/1086757520 shutdown_connections 2024-04-06T03:29:28.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.983+0000 7fa4c084e700 1 -- 172.21.15.47:0/1086757520 wait complete. 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.984+0000 7fa4c084e700 1 Processor -- start 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.984+0000 7fa4c084e700 1 -- start start 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.984+0000 7fa4c084e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 0x7fa4bc06a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.984+0000 7fa4c084e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc106340 con 0x7fa4bc100c00 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.984+0000 7fa4ba59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 0x7fa4bc06a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.984+0000 7fa4ba59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 0x7fa4bc06a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57098/0 (socket says 172.21.15.47:57098) 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.984+0000 7fa4ba59c700 1 -- 172.21.15.47:0/49832760 learned_addr learned my addr 172.21.15.47:0/49832760 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.985+0000 7fa4ba59c700 1 -- 172.21.15.47:0/49832760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc199870 con 0x7fa4bc100c00 2024-04-06T03:29:28.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.985+0000 7fa4ba59c700 1 --2- 172.21.15.47:0/49832760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 0x7fa4bc06a140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00b5c0 tx=0x7fa4ac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:28.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.985+0000 7fa4ab7fe700 1 -- 172.21.15.47:0/49832760 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac027070 con 0x7fa4bc100c00 2024-04-06T03:29:28.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.985+0000 7fa4ab7fe700 1 -- 172.21.15.47:0/49832760 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fa4ac00be10 con 0x7fa4bc100c00 2024-04-06T03:29:28.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.985+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4bc199a40 con 0x7fa4bc100c00 2024-04-06T03:29:28.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.985+0000 7fa4ab7fe700 1 -- 172.21.15.47:0/49832760 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac022e40 con 0x7fa4bc100c00 2024-04-06T03:29:28.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.985+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc199de0 con 0x7fa4bc100c00 2024-04-06T03:29:28.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.986+0000 7fa4ab7fe700 1 -- 172.21.15.47:0/49832760 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7fa4ac02a070 con 0x7fa4bc100c00 2024-04-06T03:29:28.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.986+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4bc106ac0 con 0x7fa4bc100c00 2024-04-06T03:29:28.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.986+0000 7fa4ab7fe700 1 --2- 172.21.15.47:0/49832760 >> v2:172.21.15.47:6800/850698093 conn(0x7fa4a4038eb0 0x7fa4a403b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:28.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.986+0000 7fa4ab7fe700 1 -- 172.21.15.47:0/49832760 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fa4ac01e030 con 0x7fa4bc100c00 2024-04-06T03:29:28.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.986+0000 7fa4b9d9b700 1 --2- 172.21.15.47:0/49832760 >> v2:172.21.15.47:6800/850698093 conn(0x7fa4a4038eb0 0x7fa4a403b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:28.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.987+0000 7fa4b9d9b700 1 --2- 172.21.15.47:0/49832760 >> v2:172.21.15.47:6800/850698093 conn(0x7fa4a4038eb0 0x7fa4a403b370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006fd0 tx=0x7fa4b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:28.991+0000 7fa4ab7fe700 1 -- 172.21.15.47:0/49832760 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa4ac013070 con 0x7fa4bc100c00 2024-04-06T03:29:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.199+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa4bc02dc70 con 0x7fa4a4038eb0 2024-04-06T03:29:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.202+0000 7fa4ab7fe700 1 -- 172.21.15.47:0/49832760 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa4bc02dc70 con 0x7fa4a4038eb0 2024-04-06T03:29:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 >> v2:172.21.15.47:6800/850698093 conn(0x7fa4a4038eb0 msgr2=0x7fa4a403b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 --2- 172.21.15.47:0/49832760 >> v2:172.21.15.47:6800/850698093 conn(0x7fa4a4038eb0 0x7fa4a403b370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006fd0 tx=0x7fa4b0006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 msgr2=0x7fa4bc06a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 --2- 172.21.15.47:0/49832760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 0x7fa4bc06a140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00b5c0 tx=0x7fa4ac0046b0 comp rx=0 tx=0).stop 2024-04-06T03:29:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 shutdown_connections 2024-04-06T03:29:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 --2- 172.21.15.47:0/49832760 >> v2:172.21.15.47:6800/850698093 conn(0x7fa4a4038eb0 0x7fa4a403b370 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 --2- 172.21.15.47:0/49832760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4bc100c00 0x7fa4bc06a140 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 >> 172.21.15.47:0/49832760 conn(0x7fa4bc0fc1a0 msgr2=0x7fa4bc0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 shutdown_connections 2024-04-06T03:29:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:29.204+0000 7fa4c084e700 1 -- 172.21.15.47:0/49832760 wait complete. 2024-04-06T03:29:29.964 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi102 2024-04-06T03:29:29.964 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:29:29.964 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.conf 2024-04-06T03:29:29.984 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:29:29.984 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:29:30.041 INFO:tasks.cephadm:Adding host smithi102 to orchestrator... 2024-04-06T03:29:30.041 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch host add smithi102 2024-04-06T03:29:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:29:30.480 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:30.480 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:30.480 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:30.480 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:30.481 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:29:30.481 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-06T03:29:30.481 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:29:30.481 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:30.481 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:30.481 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:30 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:31.465 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:31 smithi047 ceph-mon[29365]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:29:31.465 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:31 smithi047 ceph-mon[29365]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:29:31.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.791+0000 7fd18da8e700 1 -- 172.21.15.47:0/3773751603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 msgr2=0x7fd1881032f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.791+0000 7fd18da8e700 1 --2- 172.21.15.47:0/3773751603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 0x7fd1881032f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd178009910 tx=0x7fd178009c20 comp rx=0 tx=0).stop 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.791+0000 7fd18da8e700 1 -- 172.21.15.47:0/3773751603 shutdown_connections 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.791+0000 7fd18da8e700 1 --2- 172.21.15.47:0/3773751603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 0x7fd1881032f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.791+0000 7fd18da8e700 1 -- 172.21.15.47:0/3773751603 >> 172.21.15.47:0/3773751603 conn(0x7fd1880fc6c0 msgr2=0x7fd1880feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.791+0000 7fd18da8e700 1 -- 172.21.15.47:0/3773751603 shutdown_connections 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.791+0000 7fd18da8e700 1 -- 172.21.15.47:0/3773751603 wait complete. 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.792+0000 7fd18da8e700 1 Processor -- start 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.792+0000 7fd18da8e700 1 -- start start 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.792+0000 7fd18da8e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 0x7fd188199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.792+0000 7fd18da8e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd18810ba00 con 0x7fd188102f10 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.792+0000 7fd1877fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 0x7fd188199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.792+0000 7fd1877fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 0x7fd188199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57108/0 (socket says 172.21.15.47:57108) 2024-04-06T03:29:31.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.792+0000 7fd1877fe700 1 -- 172.21.15.47:0/3295868333 learned_addr learned my addr 172.21.15.47:0/3295868333 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:31.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.793+0000 7fd1877fe700 1 -- 172.21.15.47:0/3295868333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd188199680 con 0x7fd188102f10 2024-04-06T03:29:31.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.793+0000 7fd1877fe700 1 --2- 172.21.15.47:0/3295868333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 0x7fd188199140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd178004ed0 tx=0x7fd178004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:31.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.793+0000 7fd184ff9700 1 -- 172.21.15.47:0/3295868333 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd178026070 con 0x7fd188102f10 2024-04-06T03:29:31.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.793+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd188199910 con 0x7fd188102f10 2024-04-06T03:29:31.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.793+0000 7fd184ff9700 1 -- 172.21.15.47:0/3295868333 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd17800b750 con 0x7fd188102f10 2024-04-06T03:29:31.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.793+0000 7fd184ff9700 1 -- 172.21.15.47:0/3295868333 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1780039a0 con 0x7fd188102f10 2024-04-06T03:29:31.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.793+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd188199d70 con 0x7fd188102f10 2024-04-06T03:29:31.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.794+0000 7fd184ff9700 1 -- 172.21.15.47:0/3295868333 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7fd178029070 con 0x7fd188102f10 2024-04-06T03:29:31.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.794+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18806a9f0 con 0x7fd188102f10 2024-04-06T03:29:31.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.794+0000 7fd184ff9700 1 --2- 172.21.15.47:0/3295868333 >> v2:172.21.15.47:6800/850698093 conn(0x7fd170038e60 0x7fd17003b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:31.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.794+0000 7fd184ff9700 1 -- 172.21.15.47:0/3295868333 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fd17801e070 con 0x7fd188102f10 2024-04-06T03:29:31.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.794+0000 7fd186ffd700 1 --2- 172.21.15.47:0/3295868333 >> v2:172.21.15.47:6800/850698093 conn(0x7fd170038e60 0x7fd17003b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:31.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.795+0000 7fd186ffd700 1 --2- 172.21.15.47:0/3295868333 >> v2:172.21.15.47:6800/850698093 conn(0x7fd170038e60 0x7fd17003b320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd17c006fd0 tx=0x7fd17c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:31.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:31.799+0000 7fd184ff9700 1 -- 172.21.15.47:0/3295868333 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd178013070 con 0x7fd188102f10 2024-04-06T03:29:32.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:32.007+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}) -- 0x7fd18819a4a0 con 0x7fd170038e60 2024-04-06T03:29:32.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:32 smithi047 ceph-mon[29365]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:33.991 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:33 smithi047 ceph-mon[29365]: Deploying cephadm binary to smithi102 2024-04-06T03:29:35.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:35 smithi047 ceph-mon[29365]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.334+0000 7fd184ff9700 1 -- 172.21.15.47:0/3295868333 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd18819a4a0 con 0x7fd170038e60 2024-04-06T03:29:36.335 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi102' with addr '172.21.15.102' 2024-04-06T03:29:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 >> v2:172.21.15.47:6800/850698093 conn(0x7fd170038e60 msgr2=0x7fd17003b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 --2- 172.21.15.47:0/3295868333 >> v2:172.21.15.47:6800/850698093 conn(0x7fd170038e60 0x7fd17003b320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd17c006fd0 tx=0x7fd17c006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 msgr2=0x7fd188199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 --2- 172.21.15.47:0/3295868333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 0x7fd188199140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd178004ed0 tx=0x7fd178004fb0 comp rx=0 tx=0).stop 2024-04-06T03:29:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 shutdown_connections 2024-04-06T03:29:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 --2- 172.21.15.47:0/3295868333 >> v2:172.21.15.47:6800/850698093 conn(0x7fd170038e60 0x7fd17003b320 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 --2- 172.21.15.47:0/3295868333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188102f10 0x7fd188199140 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 >> 172.21.15.47:0/3295868333 conn(0x7fd1880fc6c0 msgr2=0x7fd1880fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 shutdown_connections 2024-04-06T03:29:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:36.336+0000 7fd18da8e700 1 -- 172.21.15.47:0/3295868333 wait complete. 2024-04-06T03:29:36.943 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch host ls --format=json 2024-04-06T03:29:37.188 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:29:37.560 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:37.560 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:37 smithi047 ceph-mon[29365]: Added host smithi102 2024-04-06T03:29:37.561 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:37.561 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:37 smithi047 ceph-mon[29365]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:37.561 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:38.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:38.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.782+0000 7f8421c64700 1 -- 172.21.15.47:0/4047540995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 msgr2=0x7f841c1022e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:38.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.782+0000 7f8421c64700 1 --2- 172.21.15.47:0/4047540995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 0x7f841c1022e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f840c009910 tx=0x7f840c009c20 comp rx=0 tx=0).stop 2024-04-06T03:29:38.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.782+0000 7f8421c64700 1 -- 172.21.15.47:0/4047540995 shutdown_connections 2024-04-06T03:29:38.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.782+0000 7f8421c64700 1 --2- 172.21.15.47:0/4047540995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 0x7f841c1022e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:38.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.782+0000 7f8421c64700 1 -- 172.21.15.47:0/4047540995 >> 172.21.15.47:0/4047540995 conn(0x7f841c0fd7b0 msgr2=0x7f841c0ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:38.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.782+0000 7f8421c64700 1 -- 172.21.15.47:0/4047540995 shutdown_connections 2024-04-06T03:29:38.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.782+0000 7f8421c64700 1 -- 172.21.15.47:0/4047540995 wait complete. 2024-04-06T03:29:38.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f8421c64700 1 Processor -- start 2024-04-06T03:29:38.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f8421c64700 1 -- start start 2024-04-06T03:29:38.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f8421c64700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 0x7f841c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:38.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f8421c64700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f841c10b980 con 0x7f841c101f00 2024-04-06T03:29:38.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f841b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 0x7f841c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:38.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f841b7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 0x7f841c0745d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59714/0 (socket says 172.21.15.47:59714) 2024-04-06T03:29:38.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f841b7fe700 1 -- 172.21.15.47:0/2246495241 learned_addr learned my addr 172.21.15.47:0/2246495241 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:38.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f841b7fe700 1 -- 172.21.15.47:0/2246495241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c0764c0 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.783+0000 7f841b7fe700 1 --2- 172.21.15.47:0/2246495241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 0x7f841c0745d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f840c006010 tx=0x7f840c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.784+0000 7f8418ff9700 1 -- 172.21.15.47:0/2246495241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c026070 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.784+0000 7f8418ff9700 1 -- 172.21.15.47:0/2246495241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f840c00bc00 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.784+0000 7f8418ff9700 1 -- 172.21.15.47:0/2246495241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c003870 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.784+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c074b70 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.784+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c075030 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.784+0000 7f8418ff9700 1 -- 172.21.15.47:0/2246495241 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7f840c029070 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.784+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c1033e0 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.785+0000 7f8418ff9700 1 --2- 172.21.15.47:0/2246495241 >> v2:172.21.15.47:6800/850698093 conn(0x7f8404038e60 0x7f840403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.785+0000 7f8418ff9700 1 -- 172.21.15.47:0/2246495241 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f840c01e070 con 0x7f841c101f00 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.785+0000 7f841affd700 1 --2- 172.21.15.47:0/2246495241 >> v2:172.21.15.47:6800/850698093 conn(0x7f8404038e60 0x7f840403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.785+0000 7f841affd700 1 --2- 172.21.15.47:0/2246495241 >> v2:172.21.15.47:6800/850698093 conn(0x7f8404038e60 0x7f840403b320 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8410006fd0 tx=0x7f8410006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:38.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.790+0000 7f8418ff9700 1 -- 172.21.15.47:0/2246495241 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f840c013070 con 0x7f841c101f00 2024-04-06T03:29:38.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.997+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f841c063900 con 0x7f8404038e60 2024-04-06T03:29:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:38.998+0000 7f8418ff9700 1 -- 172.21.15.47:0/2246495241 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f841c063900 con 0x7f8404038e60 2024-04-06T03:29:38.998 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:29:38.999 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}] 2024-04-06T03:29:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 >> v2:172.21.15.47:6800/850698093 conn(0x7f8404038e60 msgr2=0x7f840403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 --2- 172.21.15.47:0/2246495241 >> v2:172.21.15.47:6800/850698093 conn(0x7f8404038e60 0x7f840403b320 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8410006fd0 tx=0x7f8410006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 msgr2=0x7f841c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 --2- 172.21.15.47:0/2246495241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 0x7f841c0745d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f840c006010 tx=0x7f840c005030 comp rx=0 tx=0).stop 2024-04-06T03:29:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 shutdown_connections 2024-04-06T03:29:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 --2- 172.21.15.47:0/2246495241 >> v2:172.21.15.47:6800/850698093 conn(0x7f8404038e60 0x7f840403b320 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:39.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 --2- 172.21.15.47:0/2246495241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f841c101f00 0x7f841c0745d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 >> 172.21.15.47:0/2246495241 conn(0x7f841c0fd7b0 msgr2=0x7f841c109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 shutdown_connections 2024-04-06T03:29:39.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:39.000+0000 7f8421c64700 1 -- 172.21.15.47:0/2246495241 wait complete. 2024-04-06T03:29:39.567 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:39 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:39.568 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:39 smithi047 ceph-mon[29365]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:39.569 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-06T03:29:39.569 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd crush tunables default 2024-04-06T03:29:39.805 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:29:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:40 smithi047 ceph-mon[29365]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:29:41.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.257+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/2666024591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 msgr2=0x7fd9c01022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:41.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.257+0000 7fd9c4fdd700 1 --2- 172.21.15.47:0/2666024591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 0x7fd9c01022f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009910 tx=0x7fd9b0009c20 comp rx=0 tx=0).stop 2024-04-06T03:29:41.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.257+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/2666024591 shutdown_connections 2024-04-06T03:29:41.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.257+0000 7fd9c4fdd700 1 --2- 172.21.15.47:0/2666024591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 0x7fd9c01022f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:41.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.257+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/2666024591 >> 172.21.15.47:0/2666024591 conn(0x7fd9c00fd7e0 msgr2=0x7fd9c00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:41.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.257+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/2666024591 shutdown_connections 2024-04-06T03:29:41.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.257+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/2666024591 wait complete. 2024-04-06T03:29:41.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.258+0000 7fd9c4fdd700 1 Processor -- start 2024-04-06T03:29:41.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.258+0000 7fd9c4fdd700 1 -- start start 2024-04-06T03:29:41.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.258+0000 7fd9c4fdd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 0x7fd9c0196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.258+0000 7fd9c4fdd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c010b990 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.258+0000 7fd9be59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 0x7fd9c0196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.258+0000 7fd9be59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 0x7fd9c0196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59730/0 (socket says 172.21.15.47:59730) 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.258+0000 7fd9be59c700 1 -- 172.21.15.47:0/3856066125 learned_addr learned my addr 172.21.15.47:0/3856066125 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.259+0000 7fd9be59c700 1 -- 172.21.15.47:0/3856066125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c0197410 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.259+0000 7fd9be59c700 1 --2- 172.21.15.47:0/3856066125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 0x7fd9c0196ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0006010 tx=0x7fd9b0005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.259+0000 7fd9af7fe700 1 -- 172.21.15.47:0/3856066125 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b0026070 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.259+0000 7fd9af7fe700 1 -- 172.21.15.47:0/3856066125 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd9b000bba0 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.259+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c0197700 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.259+0000 7fd9af7fe700 1 -- 172.21.15.47:0/3856066125 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b00037d0 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.259+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c019b7a0 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.260+0000 7fd9af7fe700 1 -- 172.21.15.47:0/3856066125 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7fd9b0029070 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.260+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c01033f0 con 0x7fd9c0101f10 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.260+0000 7fd9af7fe700 1 --2- 172.21.15.47:0/3856066125 >> v2:172.21.15.47:6800/850698093 conn(0x7fd9a8038eb0 0x7fd9a803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:41.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.260+0000 7fd9af7fe700 1 -- 172.21.15.47:0/3856066125 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fd9b001e070 con 0x7fd9c0101f10 2024-04-06T03:29:41.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.260+0000 7fd9bdd9b700 1 --2- 172.21.15.47:0/3856066125 >> v2:172.21.15.47:6800/850698093 conn(0x7fd9a8038eb0 0x7fd9a803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:41.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.261+0000 7fd9bdd9b700 1 --2- 172.21.15.47:0/3856066125 >> v2:172.21.15.47:6800/850698093 conn(0x7fd9a8038eb0 0x7fd9a803b370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006fd0 tx=0x7fd9b4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:41.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.265+0000 7fd9af7fe700 1 -- 172.21.15.47:0/3856066125 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd9b0013070 con 0x7fd9c0101f10 2024-04-06T03:29:41.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:41.477+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd9c0063900 con 0x7fd9c0101f10 2024-04-06T03:29:41.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:41 smithi047 ceph-mon[29365]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.433+0000 7fd9af7fe700 1 -- 172.21.15.47:0/3856066125 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fd9b000fe20 con 0x7fd9c0101f10 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 >> v2:172.21.15.47:6800/850698093 conn(0x7fd9a8038eb0 msgr2=0x7fd9a803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 --2- 172.21.15.47:0/3856066125 >> v2:172.21.15.47:6800/850698093 conn(0x7fd9a8038eb0 0x7fd9a803b370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006fd0 tx=0x7fd9b4006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 msgr2=0x7fd9c0196ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 --2- 172.21.15.47:0/3856066125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 0x7fd9c0196ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0006010 tx=0x7fd9b0005030 comp rx=0 tx=0).stop 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 shutdown_connections 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 --2- 172.21.15.47:0/3856066125 >> v2:172.21.15.47:6800/850698093 conn(0x7fd9a8038eb0 0x7fd9a803b370 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 --2- 172.21.15.47:0/3856066125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9c0101f10 0x7fd9c0196ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 >> 172.21.15.47:0/3856066125 conn(0x7fd9c00fd7e0 msgr2=0x7fd9c0109a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:42.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 shutdown_connections 2024-04-06T03:29:42.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:29:42.435+0000 7fd9c4fdd700 1 -- 172.21.15.47:0/3856066125 wait complete. 2024-04-06T03:29:42.437 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-04-06T03:29:42.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3856066125' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-06T03:29:42.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:42.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:42.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:29:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:29:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:42 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:42.982 INFO:tasks.cephadm:Adding mon.a on smithi047 2024-04-06T03:29:42.982 INFO:tasks.cephadm:Adding mon.c on smithi047 2024-04-06T03:29:42.982 INFO:tasks.cephadm:Adding mon.b on smithi102 2024-04-06T03:29:42.982 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch apply mon '3;smithi047:172.21.15.47=a;smithi047:[v2:172.21.15.47:3301,v1:172.21.15.47:6790]=c;smithi102:172.21.15.102=b' 2024-04-06T03:29:43.207 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:29:43.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:43 smithi047 ceph-mon[29365]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:29:43.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:43 smithi047 ceph-mon[29365]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:29:43.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:43 smithi047 ceph-mon[29365]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:29:43.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:43 smithi047 ceph-mon[29365]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:29:43.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3856066125' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-06T03:29:43.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:43 smithi047 ceph-mon[29365]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:29:43.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:43 smithi047 ceph-mon[29365]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:44.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.572+0000 7ff2019a0700 1 -- 172.21.15.102:0/3684451412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 msgr2=0x7ff1fc1011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:44.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.572+0000 7ff2019a0700 1 --2- 172.21.15.102:0/3684451412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 0x7ff1fc1011d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009910 tx=0x7ff1ec009c20 comp rx=0 tx=0).stop 2024-04-06T03:29:44.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.572+0000 7ff2019a0700 1 -- 172.21.15.102:0/3684451412 shutdown_connections 2024-04-06T03:29:44.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.572+0000 7ff2019a0700 1 --2- 172.21.15.102:0/3684451412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 0x7ff1fc1011d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:44.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.572+0000 7ff2019a0700 1 -- 172.21.15.102:0/3684451412 >> 172.21.15.102:0/3684451412 conn(0x7ff1fc0fc680 msgr2=0x7ff1fc0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:44.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.572+0000 7ff2019a0700 1 -- 172.21.15.102:0/3684451412 shutdown_connections 2024-04-06T03:29:44.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.572+0000 7ff2019a0700 1 -- 172.21.15.102:0/3684451412 wait complete. 2024-04-06T03:29:44.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.573+0000 7ff2019a0700 1 Processor -- start 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.573+0000 7ff2019a0700 1 -- start start 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.573+0000 7ff2019a0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 0x7ff1fc195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.573+0000 7ff2019a0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc10a870 con 0x7ff1fc100df0 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.573+0000 7ff1faffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 0x7ff1fc195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.573+0000 7ff1faffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 0x7ff1fc195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.102:57104/0 (socket says 172.21.15.102:57104) 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.573+0000 7ff1faffd700 1 -- 172.21.15.102:0/448697917 learned_addr learned my addr 172.21.15.102:0/448697917 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.574+0000 7ff1faffd700 1 -- 172.21.15.102:0/448697917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1fc196370 con 0x7ff1fc100df0 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.574+0000 7ff1faffd700 1 --2- 172.21.15.102:0/448697917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 0x7ff1fc195e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec004f80 tx=0x7ff1ec005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.574+0000 7ff20099e700 1 -- 172.21.15.102:0/448697917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec026070 con 0x7ff1fc100df0 2024-04-06T03:29:44.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.574+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc196660 con 0x7ff1fc100df0 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.574+0000 7ff20099e700 1 -- 172.21.15.102:0/448697917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7ff1ec00bba0 con 0x7ff1fc100df0 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.574+0000 7ff20099e700 1 -- 172.21.15.102:0/448697917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec003930 con 0x7ff1fc100df0 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.574+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc19a6b0 con 0x7ff1fc100df0 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.575+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1fc1022d0 con 0x7ff1fc100df0 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.575+0000 7ff20099e700 1 -- 172.21.15.102:0/448697917 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7ff1ec029070 con 0x7ff1fc100df0 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.575+0000 7ff20099e700 1 --2- 172.21.15.102:0/448697917 >> v2:172.21.15.47:6800/850698093 conn(0x7ff1e4038e60 0x7ff1e403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.575+0000 7ff20099e700 1 -- 172.21.15.102:0/448697917 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7ff1ec01e070 con 0x7ff1fc100df0 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.575+0000 7ff1fa7fc700 1 --2- 172.21.15.102:0/448697917 >> v2:172.21.15.47:6800/850698093 conn(0x7ff1e4038e60 0x7ff1e403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:44.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.576+0000 7ff1fa7fc700 1 --2- 172.21.15.102:0/448697917 >> v2:172.21.15.47:6800/850698093 conn(0x7ff1e4038e60 0x7ff1e403b320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0006fd0 tx=0x7ff1f0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:44.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.580+0000 7ff20099e700 1 -- 172.21.15.102:0/448697917 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff1ec013070 con 0x7ff1fc100df0 2024-04-06T03:29:44.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.788+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi047:[v2:172.21.15.47:3301,v1:172.21.15.47:6790]=c;smithi102:172.21.15.102=b", "target": ["mon-mgr", ""]}) -- 0x7ff1fc197140 con 0x7ff1e4038e60 2024-04-06T03:29:44.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.795+0000 7ff20099e700 1 -- 172.21.15.102:0/448697917 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff1fc197140 con 0x7ff1e4038e60 2024-04-06T03:29:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mon update... 2024-04-06T03:29:44.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 >> v2:172.21.15.47:6800/850698093 conn(0x7ff1e4038e60 msgr2=0x7ff1e403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:44.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 --2- 172.21.15.102:0/448697917 >> v2:172.21.15.47:6800/850698093 conn(0x7ff1e4038e60 0x7ff1e403b320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0006fd0 tx=0x7ff1f0006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:44.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 msgr2=0x7ff1fc195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:44.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 --2- 172.21.15.102:0/448697917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 0x7ff1fc195e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec004f80 tx=0x7ff1ec005060 comp rx=0 tx=0).stop 2024-04-06T03:29:44.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 shutdown_connections 2024-04-06T03:29:44.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 --2- 172.21.15.102:0/448697917 >> v2:172.21.15.47:6800/850698093 conn(0x7ff1e4038e60 0x7ff1e403b320 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:44.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 --2- 172.21.15.102:0/448697917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1fc100df0 0x7ff1fc195e30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:44.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 >> 172.21.15.102:0/448697917 conn(0x7ff1fc0fc680 msgr2=0x7ff1fc108930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:44.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 shutdown_connections 2024-04-06T03:29:44.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:44.797+0000 7ff2019a0700 1 -- 172.21.15.102:0/448697917 wait complete. 2024-04-06T03:29:44.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:44 smithi047 ceph-mon[29365]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:45.403 DEBUG:teuthology.orchestra.run.smithi047:mon.c> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.c.service 2024-04-06T03:29:45.405 DEBUG:teuthology.orchestra.run.smithi102:mon.b> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.b.service 2024-04-06T03:29:45.407 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-06T03:29:45.408 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T03:29:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi047:[v2:172.21.15.47:3301,v1:172.21.15.47:6790]=c;smithi102:172.21.15.102=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi047:[v2:172.21.15.47:3301,v1:172.21.15.47:6790]=c;smithi102:172.21.15.102=b;count:3 2024-04-06T03:29:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:29:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:29:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:45 smithi047 ceph-mon[29365]: Deploying daemon mon.b on smithi102 2024-04-06T03:29:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:29:47.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:46 smithi047 ceph-mon[29365]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:48.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 -- 172.21.15.102:0/3302675240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 msgr2=0x7f8f80102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:48.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 --2- 172.21.15.102:0/3302675240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 0x7f8f80102320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009910 tx=0x7f8f7c009c20 comp rx=0 tx=0).stop 2024-04-06T03:29:48.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 -- 172.21.15.102:0/3302675240 shutdown_connections 2024-04-06T03:29:48.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 --2- 172.21.15.102:0/3302675240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 0x7f8f80102320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:48.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 -- 172.21.15.102:0/3302675240 >> 172.21.15.102:0/3302675240 conn(0x7f8f800fd7d0 msgr2=0x7f8f800ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 -- 172.21.15.102:0/3302675240 shutdown_connections 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 -- 172.21.15.102:0/3302675240 wait complete. 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 Processor -- start 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 -- start start 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 0x7f8f80196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.909+0000 7f8f87ce8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8010b9c0 con 0x7f8f80101f40 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.910+0000 7f8f85a84700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 0x7f8f80196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.910+0000 7f8f85a84700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 0x7f8f80196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.102:47352/0 (socket says 172.21.15.102:47352) 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.910+0000 7f8f85a84700 1 -- 172.21.15.102:0/2332320253 learned_addr learned my addr 172.21.15.102:0/2332320253 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.910+0000 7f8f85a84700 1 -- 172.21.15.102:0/2332320253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f801974a0 con 0x7f8f80101f40 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.910+0000 7f8f85a84700 1 --2- 172.21.15.102:0/2332320253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 0x7f8f80196f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c004f80 tx=0x7f8f7c005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.910+0000 7f8f76ffd700 1 -- 172.21.15.102:0/2332320253 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7c026070 con 0x7f8f80101f40 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.911+0000 7f8f76ffd700 1 -- 172.21.15.102:0/2332320253 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f8f7c00bba0 con 0x7f8f80101f40 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.911+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f80197790 con 0x7f8f80101f40 2024-04-06T03:29:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.911+0000 7f8f76ffd700 1 -- 172.21.15.102:0/2332320253 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7c003930 con 0x7f8f80101f40 2024-04-06T03:29:48.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.911+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8019b830 con 0x7f8f80101f40 2024-04-06T03:29:48.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.911+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f80103420 con 0x7f8f80101f40 2024-04-06T03:29:48.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.912+0000 7f8f76ffd700 1 -- 172.21.15.102:0/2332320253 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7f8f7c029070 con 0x7f8f80101f40 2024-04-06T03:29:48.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.912+0000 7f8f76ffd700 1 --2- 172.21.15.102:0/2332320253 >> v2:172.21.15.47:6800/850698093 conn(0x7f8f6c038eb0 0x7f8f6c03b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:48.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.912+0000 7f8f76ffd700 1 -- 172.21.15.102:0/2332320253 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f8f7c01e070 con 0x7f8f80101f40 2024-04-06T03:29:48.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.912+0000 7f8f85283700 1 --2- 172.21.15.102:0/2332320253 >> v2:172.21.15.47:6800/850698093 conn(0x7f8f6c038eb0 0x7f8f6c03b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:48.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.912+0000 7f8f85283700 1 --2- 172.21.15.102:0/2332320253 >> v2:172.21.15.47:6800/850698093 conn(0x7f8f6c038eb0 0x7f8f6c03b370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8f70006fd0 tx=0x7f8f70006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:48.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:48.917+0000 7f8f76ffd700 1 -- 172.21.15.102:0/2332320253 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8f7c013070 con 0x7f8f80101f40 2024-04-06T03:29:48.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:48 smithi047 ceph-mon[29365]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.216+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8f80063900 con 0x7f8f80101f40 2024-04-06T03:29:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.217+0000 7f8f76ffd700 1 -- 172.21.15.102:0/2332320253 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f8f7c00b7a0 con 0x7f8f80101f40 2024-04-06T03:29:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:29:49.218 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"8f6329a8-f3c5-11ee-b649-cb9ed24678a4","modified":"2024-04-06T03:28:08.062065Z","created":"2024-04-06T03:28:08.062065Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 >> v2:172.21.15.47:6800/850698093 conn(0x7f8f6c038eb0 msgr2=0x7f8f6c03b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 --2- 172.21.15.102:0/2332320253 >> v2:172.21.15.47:6800/850698093 conn(0x7f8f6c038eb0 0x7f8f6c03b370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8f70006fd0 tx=0x7f8f70006e40 comp rx=0 tx=0).stop 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 msgr2=0x7f8f80196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 --2- 172.21.15.102:0/2332320253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 0x7f8f80196f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c004f80 tx=0x7f8f7c005060 comp rx=0 tx=0).stop 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 shutdown_connections 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 --2- 172.21.15.102:0/2332320253 >> v2:172.21.15.47:6800/850698093 conn(0x7f8f6c038eb0 0x7f8f6c03b370 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 --2- 172.21.15.102:0/2332320253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f80101f40 0x7f8f80196f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 >> 172.21.15.102:0/2332320253 conn(0x7f8f800fd7d0 msgr2=0x7f8f80109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 shutdown_connections 2024-04-06T03:29:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:49.219+0000 7f8f87ce8700 1 -- 172.21.15.102:0/2332320253 wait complete. 2024-04-06T03:29:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-04-06T03:29:49.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/2332320253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:29:50.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 podman[32801]: 2024-04-06 03:29:50.010552824 +0000 UTC m=+0.115523917 container create 3685eb8a3a6c01baabdb0dbcf99f2bbe5fb370a1b6c72e94bed67867ce75325b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-06T03:29:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 podman[32801]: 2024-04-06 03:29:50.237953905 +0000 UTC m=+0.342924999 container init 3685eb8a3a6c01baabdb0dbcf99f2bbe5fb370a1b6c72e94bed67867ce75325b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9f19235, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-06T03:29:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 podman[32801]: 2024-04-06 03:29:50.240820769 +0000 UTC m=+0.345791863 container start 3685eb8a3a6c01baabdb0dbcf99f2bbe5fb370a1b6c72e94bed67867ce75325b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9f19235, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: set uid:gid to 167:167 (ceph:ceph) 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev), process ceph-mon, pid 2 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: pidfile_write: ignore empty --pid-file 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: load: jerasure load: lrc 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: RocksDB version: 7.9.2 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Git sha 0 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Compile date 2024-04-05 08:39:05 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: DB SUMMARY 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: DB Session ID: WTCFC4SB05XKVUM8OVGE 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: CURRENT file: CURRENT 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: IDENTITY file: IDENTITY 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-06T03:29:50.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.error_if_exists: 0 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.create_if_missing: 0 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.paranoid_checks: 1 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.env: 0x55926e9a3c60 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.fs: PosixFileSystem 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.info_log: 0x559270601ae0 2024-04-06T03:29:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_file_opening_threads: 16 2024-04-06T03:29:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.statistics: (nil) 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.use_fsync: 0 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_log_file_size: 0 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.keep_log_file_num: 1000 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.recycle_log_file_num: 0 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.allow_fallocate: 1 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.allow_mmap_reads: 0 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.allow_mmap_writes: 0 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.use_direct_reads: 0 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-06T03:29:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.create_missing_column_families: 0 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.db_log_dir: 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.wal_dir: 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.advise_random_on_open: 1 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.db_write_buffer_size: 0 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.write_buffer_manager: 0x5592705d41e0 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-06T03:29:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.rate_limiter: (nil) 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.wal_recovery_mode: 2 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.enable_thread_tracking: 0 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.enable_pipelined_write: 0 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.unordered_write: 0 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.row_cache: None 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.wal_filter: None 2024-04-06T03:29:50.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.allow_ingest_behind: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.two_write_queues: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.manual_wal_flush: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.wal_compression: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.atomic_flush: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.log_readahead_size: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.best_efforts_recovery: 0 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-06T03:29:50.590 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.allow_data_in_errors: 0 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.db_host_id: __hostname__ 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_background_jobs: 2 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_background_compactions: -1 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_subcompactions: 1 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_total_wal_size: 0 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_open_files: -1 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bytes_per_sync: 0 2024-04-06T03:29:50.591 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_readahead_size: 0 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_background_flushes: -1 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Compression algorithms supported: 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: kZSTD supported: 0 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: kXpressCompression supported: 0 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: kLZ4HCCompression supported: 1 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: kZlibCompression supported: 1 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: kSnappyCompression supported: 1 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: kLZ4Compression supported: 1 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: kBZip2Compression supported: 0 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-06T03:29:50.592 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.merge_operator: 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_filter: None 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_filter_factory: None 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.sst_partitioner_factory: None 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559270601be0) 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout: cache_index_and_filter_blocks: 1 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout: pin_top_level_index_and_filter: 1 2024-04-06T03:29:50.593 INFO:journalctl@ceph.mon.b.smithi102.stdout: index_type: 0 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: data_block_index_type: 0 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: index_shortening: 1 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: checksum: 4 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: no_block_cache: 0 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: block_cache: 0x559270605090 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: block_cache_name: BinnedLRUCache 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: block_cache_options: 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: capacity : 536870912 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: num_shard_bits : 4 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: strict_capacity_limit : 0 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: high_pri_pool_ratio: 0.000 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: block_cache_compressed: (nil) 2024-04-06T03:29:50.594 INFO:journalctl@ceph.mon.b.smithi102.stdout: persistent_cache: (nil) 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: block_size: 4096 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: block_size_deviation: 10 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: block_restart_interval: 16 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: index_block_restart_interval: 1 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: metadata_block_size: 4096 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: partition_filters: 0 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: use_delta_encoding: 1 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: filter_policy: bloomfilter 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: whole_key_filtering: 1 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: verify_compression: 0 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: read_amp_bytes_per_bit: 0 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: format_version: 5 2024-04-06T03:29:50.595 INFO:journalctl@ceph.mon.b.smithi102.stdout: enable_index_compression: 1 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout: block_align: 0 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout: max_auto_readahead_size: 262144 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout: prepopulate_block_cache: 0 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout: initial_auto_readahead_size: 8192 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout: num_file_reads_for_auto_readahead: 2 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.write_buffer_size: 33554432 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_write_buffer_number: 2 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression: NoCompression 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression: Disabled 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.prefix_extractor: nullptr 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.num_levels: 7 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-06T03:29:50.596 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.level: 32767 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.strategy: 0 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-06T03:29:50.597 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.enabled: false 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.target_file_size_base: 67108864 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-06T03:29:50.598 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.arena_block_size: 1048576 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.disable_auto_compactions: 0 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-06T03:29:50.599 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.table_properties_collectors: 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.inplace_update_support: 0 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.bloom_locality: 0 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.max_successive_merges: 0 2024-04-06T03:29:50.600 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.paranoid_file_checks: 0 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.force_consistency_checks: 1 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.report_bg_io_stats: 0 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.ttl: 2592000 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.enable_blob_files: false 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.min_blob_size: 0 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.blob_file_size: 268435456 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-06T03:29:50.601 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.blob_file_starting_level: 0 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dbd66ab0-e3f0-4970-9f70-87e4a00dfccc 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374190272356, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374190272767, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712374190, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dbd66ab0-e3f0-4970-9f70-87e4a00dfccc", "db_session_id": "WTCFC4SB05XKVUM8OVGE", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374190272846, "job": 1, "event": "recovery_finished"} 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5592706f6000 2024-04-06T03:29:50.602 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: DB pointer 0x5592706e0000 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: ** DB Stats ** 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: ** Compaction Stats [default] ** 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-06T03:29:50.603 INFO:journalctl@ceph.mon.b.smithi102.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: ** Compaction Stats [default] ** 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T03:29:50.604 INFO:journalctl@ceph.mon.b.smithi102.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T03:29:50.605 INFO:journalctl@ceph.mon.b.smithi102.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-06T03:29:50.605 INFO:journalctl@ceph.mon.b.smithi102.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T03:29:50.605 INFO:journalctl@ceph.mon.b.smithi102.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout: Block cache BinnedLRUCache@0x559270605090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout: 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: using public_addr v2:172.21.15.102:0/0 -> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: starting mon.b rank -1 at public addrs [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] at bind addrs [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(???) e0 preinit fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).mds e1 new map 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout: e1 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T03:29:50.606 INFO:journalctl@ceph.mon.b.smithi102.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout: legacy client fscid: -1 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout: 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout: No filesystems configured 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.607 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3856066125' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:29:50.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3856066125' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi047:[v2:172.21.15.47:3301,v1:172.21.15.47:6790]=c;smithi102:172.21.15.102=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi047:[v2:172.21.15.47:3301,v1:172.21.15.47:6790]=c;smithi102:172.21.15.102=b;count:3 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:29:50.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:50.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: Deploying daemon mon.b on smithi102 2024-04-06T03:29:50.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:50.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:50.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/2332320253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:29:50.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 ceph-mon[32821]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-06T03:29:50.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 bash[32801]: 3685eb8a3a6c01baabdb0dbcf99f2bbe5fb370a1b6c72e94bed67867ce75325b 2024-04-06T03:29:50.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:50 smithi102 systemd[1]: Started Ceph mon.b for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:29:50.829 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-06T03:29:50.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T03:29:51.061 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:29:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.596+0000 7f873242f700 1 -- 172.21.15.102:0/2725221887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 msgr2=0x7f8714005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.596+0000 7f873242f700 1 --2- 172.21.15.102:0/2725221887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 0x7f8714005a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f872c100bd0 tx=0x7f871c00feb0 comp rx=0 tx=0).stop 2024-04-06T03:29:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.596+0000 7f873242f700 1 -- 172.21.15.102:0/2725221887 shutdown_connections 2024-04-06T03:29:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.596+0000 7f873242f700 1 --2- 172.21.15.102:0/2725221887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 0x7f8714005a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.596+0000 7f873242f700 1 -- 172.21.15.102:0/2725221887 >> 172.21.15.102:0/2725221887 conn(0x7f872c0fc770 msgr2=0x7f872c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.596+0000 7f873242f700 1 -- 172.21.15.102:0/2725221887 shutdown_connections 2024-04-06T03:29:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.596+0000 7f873242f700 1 -- 172.21.15.102:0/2725221887 wait complete. 2024-04-06T03:29:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.597+0000 7f873242f700 1 Processor -- start 2024-04-06T03:29:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.597+0000 7f873242f700 1 -- start start 2024-04-06T03:29:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f873242f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 0x7f872c195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f873242f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 0x7f872c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f873242f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f872c108430 con 0x7f87140035c0 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f873242f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f872c1082b0 con 0x7f872c196480 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 0x7f872c195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 0x7f872c195f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.102:53696/0 (socket says 172.21.15.102:53696) 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872bfff700 1 -- 172.21.15.102:0/3504905555 learned_addr learned my addr 172.21.15.102:0/3504905555 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872b7fe700 1 --2- 172.21.15.102:0/3504905555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 0x7f872c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872b7fe700 1 -- 172.21.15.102:0/3504905555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 msgr2=0x7f872c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872b7fe700 1 -- 172.21.15.102:0/3504905555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 msgr2=0x7f872c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872b7fe700 1 --2- 172.21.15.102:0/3504905555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 0x7f872c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-06T03:29:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872b7fe700 1 --2- 172.21.15.102:0/3504905555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 0x7f872c19a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872bfff700 1 -- 172.21.15.102:0/3504905555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 msgr2=0x7f872c19a810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872bfff700 1 --2- 172.21.15.102:0/3504905555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 0x7f872c19a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.598+0000 7f872bfff700 1 -- 172.21.15.102:0/3504905555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872c196ac0 con 0x7f87140035c0 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.599+0000 7f872bfff700 1 --2- 172.21.15.102:0/3504905555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 0x7f872c195f40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f871c0059d0 tx=0x7f871c0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.599+0000 7f87297fa700 1 -- 172.21.15.102:0/3504905555 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f871c013960 con 0x7f87140035c0 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.599+0000 7f87297fa700 1 -- 172.21.15.102:0/3504905555 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f871c004030 con 0x7f87140035c0 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.599+0000 7f87297fa700 1 -- 172.21.15.102:0/3504905555 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f871c003c90 con 0x7f87140035c0 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.599+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872c19ad50 con 0x7f87140035c0 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.599+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f872c19b2b0 con 0x7f87140035c0 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.600+0000 7f87297fa700 1 -- 172.21.15.102:0/3504905555 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7f871c023070 con 0x7f87140035c0 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.600+0000 7f87297fa700 1 --2- 172.21.15.102:0/3504905555 >> v2:172.21.15.47:6800/850698093 conn(0x7f8718038df0 0x7f871803b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:29:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.600+0000 7f87297fa700 1 -- 172.21.15.102:0/3504905555 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f871c020050 con 0x7f87140035c0 2024-04-06T03:29:55.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.600+0000 7f872b7fe700 1 --2- 172.21.15.102:0/3504905555 >> v2:172.21.15.47:6800/850698093 conn(0x7f8718038df0 0x7f871803b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:29:55.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.600+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f872c1023e0 con 0x7f87140035c0 2024-04-06T03:29:55.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.601+0000 7f872b7fe700 1 --2- 172.21.15.102:0/3504905555 >> v2:172.21.15.47:6800/850698093 conn(0x7f8718038df0 0x7f871803b2b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8720009850 tx=0x7f8720008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:29:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.606+0000 7f87297fa700 1 -- 172.21.15.102:0/3504905555 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f871c028020 con 0x7f87140035c0 2024-04-06T03:29:55.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:29:55.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: mon.a calling monitor election 2024-04-06T03:29:55.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:55.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: mon.b calling monitor election 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: monmap epoch 2 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: last_changed 2024-04-06T03:29:50.295902+0000 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: created 2024-04-06T03:28:08.062065+0000 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: min_mon_release 19 (squid) 2024-04-06T03:29:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: election_strategy: 1 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: fsmap 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: mgrmap e13: y(active, since 40s) 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: overall HEALTH_OK 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:29:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:55.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:29:55.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: mon.a calling monitor election 2024-04-06T03:29:55.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:55.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: mon.b calling monitor election 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: monmap epoch 2 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: last_changed 2024-04-06T03:29:50.295902+0000 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: created 2024-04-06T03:28:08.062065+0000 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: min_mon_release 19 (squid) 2024-04-06T03:29:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: election_strategy: 1 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: fsmap 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: mgrmap e13: y(active, since 40s) 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: overall HEALTH_OK 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:55.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:29:55.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.884+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f872c1972a0 con 0x7f87140035c0 2024-04-06T03:29:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.885+0000 7f87297fa700 1 -- 172.21.15.102:0/3504905555 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f871c0222c0 con 0x7f87140035c0 2024-04-06T03:29:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:29:55.886 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"fsid":"8f6329a8-f3c5-11ee-b649-cb9ed24678a4","modified":"2024-04-06T03:29:50.295902Z","created":"2024-04-06T03:28:08.062065Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 >> v2:172.21.15.47:6800/850698093 conn(0x7f8718038df0 msgr2=0x7f871803b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 --2- 172.21.15.102:0/3504905555 >> v2:172.21.15.47:6800/850698093 conn(0x7f8718038df0 0x7f871803b2b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8720009850 tx=0x7f8720008040 comp rx=0 tx=0).stop 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 msgr2=0x7f872c195f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 --2- 172.21.15.102:0/3504905555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 0x7f872c195f40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f871c0059d0 tx=0x7f871c0057a0 comp rx=0 tx=0).stop 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 shutdown_connections 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 --2- 172.21.15.102:0/3504905555 >> v2:172.21.15.47:6800/850698093 conn(0x7f8718038df0 0x7f871803b2b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 --2- 172.21.15.102:0/3504905555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87140035c0 0x7f872c195f40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 --2- 172.21.15.102:0/3504905555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f872c196480 0x7f872c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 >> 172.21.15.102:0/3504905555 conn(0x7f872c0fc770 msgr2=0x7f872c0fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 shutdown_connections 2024-04-06T03:29:55.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:29:55.887+0000 7f873242f700 1 -- 172.21.15.102:0/3504905555 wait complete. 2024-04-06T03:29:55.889 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 2 2024-04-06T03:29:56.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:56 smithi047 ceph-mon[29365]: Deploying daemon mon.c on smithi047 2024-04-06T03:29:56.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/3504905555' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:29:56.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:56 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:56.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:56 smithi102 ceph-mon[32821]: Deploying daemon mon.c on smithi047 2024-04-06T03:29:56.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/3504905555' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:29:56.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:56 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:57.435 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-06T03:29:57.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T03:29:57.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:57 smithi047 ceph-mon[29365]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:29:57.800 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:57 smithi102 ceph-mon[32821]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.324 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 systemd[1]: Starting Ceph mon.c for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:29:58.611 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[29365]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.612 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 podman[37654]: 2024-04-06 03:29:58.364206481 +0000 UTC m=+0.022215470 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T03:29:58.612 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 podman[37654]: 2024-04-06 03:29:58.486834413 +0000 UTC m=+0.144843384 container create e3d2b859de50106042ef482d9d97259e67d0f0caff1b444d41a15f5a3cab24e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T03:29:58.776 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:29:58 smithi102 ceph-mon[32821]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 podman[37654]: 2024-04-06 03:29:58.697816761 +0000 UTC m=+0.355825733 container init e3d2b859de50106042ef482d9d97259e67d0f0caff1b444d41a15f5a3cab24e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-c, RELEASE=squid-9f19235, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 podman[37654]: 2024-04-06 03:29:58.701122298 +0000 UTC m=+0.359131273 container start e3d2b859de50106042ef482d9d97259e67d0f0caff1b444d41a15f5a3cab24e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-c, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, io.buildah.version=1.33.5, RELEASE=squid-9f19235, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: set uid:gid to 167:167 (ceph:ceph) 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev), process ceph-mon, pid 2 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pidfile_write: ignore empty --pid-file 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: load: jerasure load: lrc 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: RocksDB version: 7.9.2 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Git sha 0 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Compile date 2024-04-05 08:39:05 2024-04-06T03:29:58.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: DB SUMMARY 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: DB Session ID: GYP2D3UPXQE80PABJEHK 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: CURRENT file: CURRENT 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: IDENTITY file: IDENTITY 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 636 ; 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.error_if_exists: 0 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.create_if_missing: 0 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.paranoid_checks: 1 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.env: 0x5579810bbc60 2024-04-06T03:29:58.908 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.fs: PosixFileSystem 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.info_log: 0x557982cdbae0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_file_opening_threads: 16 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.statistics: (nil) 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.use_fsync: 0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_log_file_size: 0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.keep_log_file_num: 1000 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.recycle_log_file_num: 0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.allow_fallocate: 1 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.allow_mmap_reads: 0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.allow_mmap_writes: 0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.use_direct_reads: 0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-06T03:29:58.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.create_missing_column_families: 0 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.db_log_dir: 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.wal_dir: 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.advise_random_on_open: 1 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.db_write_buffer_size: 0 2024-04-06T03:29:58.910 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.write_buffer_manager: 0x557982cae1e0 2024-04-06T03:29:58.913 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-06T03:29:58.913 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-06T03:29:58.913 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-06T03:29:58.913 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.rate_limiter: (nil) 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.wal_recovery_mode: 2 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.enable_thread_tracking: 0 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.enable_pipelined_write: 0 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.unordered_write: 0 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.row_cache: None 2024-04-06T03:29:58.914 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.wal_filter: None 2024-04-06T03:29:58.916 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-06T03:29:58.916 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.allow_ingest_behind: 0 2024-04-06T03:29:58.916 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.two_write_queues: 0 2024-04-06T03:29:58.916 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.manual_wal_flush: 0 2024-04-06T03:29:58.916 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.wal_compression: 0 2024-04-06T03:29:58.916 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.atomic_flush: 0 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.log_readahead_size: 0 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.best_efforts_recovery: 0 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.allow_data_in_errors: 0 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.db_host_id: __hostname__ 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_background_jobs: 2 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_background_compactions: -1 2024-04-06T03:29:58.917 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_subcompactions: 1 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_total_wal_size: 0 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_open_files: -1 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bytes_per_sync: 0 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_readahead_size: 0 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_background_flushes: -1 2024-04-06T03:29:58.918 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Compression algorithms supported: 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: kZSTD supported: 0 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: kXpressCompression supported: 0 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: kLZ4HCCompression supported: 1 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: kZlibCompression supported: 1 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: kSnappyCompression supported: 1 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: kLZ4Compression supported: 1 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: kBZip2Compression supported: 0 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.merge_operator: 2024-04-06T03:29:58.919 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_filter: None 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_filter_factory: None 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.sst_partitioner_factory: None 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557982cdbbe0) 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: index_type: 0 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: data_block_index_type: 0 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: index_shortening: 1 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: checksum: 4 2024-04-06T03:29:58.920 INFO:journalctl@ceph.mon.c.smithi047.stdout: no_block_cache: 0 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: block_cache: 0x557982cdf090 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: block_cache_options: 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: capacity : 536870912 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: num_shard_bits : 4 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: strict_capacity_limit : 0 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: block_cache_compressed: (nil) 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: persistent_cache: (nil) 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: block_size: 4096 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: block_size_deviation: 10 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: block_restart_interval: 16 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: index_block_restart_interval: 1 2024-04-06T03:29:58.921 INFO:journalctl@ceph.mon.c.smithi047.stdout: metadata_block_size: 4096 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: partition_filters: 0 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: use_delta_encoding: 1 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: filter_policy: bloomfilter 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: whole_key_filtering: 1 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: verify_compression: 0 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: format_version: 5 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: enable_index_compression: 1 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: block_align: 0 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: max_auto_readahead_size: 262144 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: prepopulate_block_cache: 0 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: initial_auto_readahead_size: 8192 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.write_buffer_size: 33554432 2024-04-06T03:29:58.922 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_write_buffer_number: 2 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression: NoCompression 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression: Disabled 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.prefix_extractor: nullptr 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.num_levels: 7 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-06T03:29:58.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.level: 32767 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.strategy: 0 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.enabled: false 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-06T03:29:58.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.target_file_size_base: 67108864 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-06T03:29:58.925 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.arena_block_size: 1048576 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.disable_auto_compactions: 0 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.table_properties_collectors: 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.inplace_update_support: 0 2024-04-06T03:29:58.926 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.bloom_locality: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.max_successive_merges: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.paranoid_file_checks: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.force_consistency_checks: 1 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.report_bg_io_stats: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.ttl: 2592000 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.enable_blob_files: false 2024-04-06T03:29:58.927 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.min_blob_size: 0 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.blob_file_size: 268435456 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.blob_file_starting_level: 0 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 87f72fb3-3228-454c-8368-9f89a29f6309 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374198731836, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-06T03:29:58.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374198732262, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712374198, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "87f72fb3-3228-454c-8368-9f89a29f6309", "db_session_id": "GYP2D3UPXQE80PABJEHK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712374198732354, "job": 1, "event": "recovery_finished"} 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557982dd0000 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: DB pointer 0x557982dba000 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout: ** DB Stats ** 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T03:29:58.929 INFO:journalctl@ceph.mon.c.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: ** Compaction Stats [default] ** 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: ** Compaction Stats [default] ** 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-06T03:29:58.930 INFO:journalctl@ceph.mon.c.smithi047.stdout: 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: Block cache BinnedLRUCache@0x557982cdf090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-06T03:29:58.931 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: using public_addrv [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: starting mon.c rank -1 at public addrs [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] at bind addrs [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(???) e0 preinit fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).mds e1 new map 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout: e1 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout: legacy client fscid: -1 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout: 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout: No filesystems configured 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-06T03:29:58.932 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3856066125' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.933 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3856066125' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi047:[v2:172.21.15.47:3301,v1:172.21.15.47:6790]=c;smithi102:172.21.15.102=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:29:58.934 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi047:[v2:172.21.15.47:3301,v1:172.21.15.47:6790]=c;smithi102:172.21.15.102=b;count:3 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: Deploying daemon mon.b on smithi102 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/2332320253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.a calling monitor election 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:58.935 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.b calling monitor election 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: monmap epoch 2 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: last_changed 2024-04-06T03:29:50.295902+0000 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: created 2024-04-06T03:28:08.062065+0000 2024-04-06T03:29:58.936 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: min_mon_release 19 (squid) 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: election_strategy: 1 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: fsmap 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mgrmap e13: y(active, since 40s) 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: overall HEALTH_OK 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: Deploying daemon mon.c on smithi047 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/3504905555' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:29:58.937 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:29:58.938 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.938 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:29:58.938 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 ceph-mon[37680]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-06T03:29:58.938 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 bash[37654]: e3d2b859de50106042ef482d9d97259e67d0f0caff1b444d41a15f5a3cab24e0 2024-04-06T03:29:58.938 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:29:58 smithi047 systemd[1]: Started Ceph mon.c for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:30:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:30:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: mon.a calling monitor election 2024-04-06T03:30:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: mon.b calling monitor election 2024-04-06T03:30:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:30:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: mon.c calling monitor election 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: monmap epoch 3 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: last_changed 2024-04-06T03:29:58.752957+0000 2024-04-06T03:30:04.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: created 2024-04-06T03:28:08.062065+0000 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: min_mon_release 19 (squid) 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: election_strategy: 1 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: 2: [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] mon.c 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: fsmap 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: mgrmap e13: y(active, since 49s) 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: overall HEALTH_OK 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:30:04.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: mon.a calling monitor election 2024-04-06T03:30:04.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: mon.b calling monitor election 2024-04-06T03:30:04.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:30:04.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:04.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: mon.c calling monitor election 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: monmap epoch 3 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: last_changed 2024-04-06T03:29:58.752957+0000 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: created 2024-04-06T03:28:08.062065+0000 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: min_mon_release 19 (squid) 2024-04-06T03:30:04.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: election_strategy: 1 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: 2: [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] mon.c 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: fsmap 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: mgrmap e13: y(active, since 49s) 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: overall HEALTH_OK 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:30:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: mon.a calling monitor election 2024-04-06T03:30:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: mon.b calling monitor election 2024-04-06T03:30:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:30:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: mon.c calling monitor election 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: monmap epoch 3 2024-04-06T03:30:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: last_changed 2024-04-06T03:29:58.752957+0000 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: created 2024-04-06T03:28:08.062065+0000 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: min_mon_release 19 (squid) 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: election_strategy: 1 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: 2: [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] mon.c 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: fsmap 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: osdmap e4: 0 total, 0 up, 0 in 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: mgrmap e13: y(active, since 49s) 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: overall HEALTH_OK 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.958+0000 7fbb09de5700 1 -- 172.21.15.102:0/3241760261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaec0062a0 msgr2=0x7fbaec008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:04.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.958+0000 7fbb09de5700 1 --2- 172.21.15.102:0/3241760261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaec0062a0 0x7fbaec008710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb04101d90 tx=0x7fbaf400fe90 comp rx=0 tx=0).stop 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.959+0000 7fbb09de5700 1 -- 172.21.15.102:0/3241760261 shutdown_connections 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.959+0000 7fbb09de5700 1 --2- 172.21.15.102:0/3241760261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaec0062a0 0x7fbaec008710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.959+0000 7fbb09de5700 1 -- 172.21.15.102:0/3241760261 >> 172.21.15.102:0/3241760261 conn(0x7fbb040fc7e0 msgr2=0x7fbb040fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.959+0000 7fbb09de5700 1 -- 172.21.15.102:0/3241760261 shutdown_connections 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.959+0000 7fbb09de5700 1 -- 172.21.15.102:0/3241760261 wait complete. 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.959+0000 7fbb09de5700 1 Processor -- start 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb09de5700 1 -- start start 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb09de5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 0x7fbb04198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb09de5700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 0x7fbb04198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb09de5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb041a11b0 0x7fbb041a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb09de5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04108460 con 0x7fbb041a11b0 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb09de5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbb041082e0 con 0x7fbaec0062a0 2024-04-06T03:30:04.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb09de5700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fbb041085e0 con 0x7fbb04198680 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb037fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 0x7fbb04198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb037fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 0x7fbb04198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51046/0 (socket says 172.21.15.102:51046) 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb037fe700 1 -- 172.21.15.102:0/3155810371 learned_addr learned my addr 172.21.15.102:0/3155810371 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb037fe700 1 -- 172.21.15.102:0/3155810371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 msgr2=0x7fbb04198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb037fe700 1 -- 172.21.15.102:0/3155810371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 msgr2=0x7fbb04198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb037fe700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 0x7fbb04198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb037fe700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 0x7fbb04198140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb03fff700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb041a11b0 0x7fbb041a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb02ffd700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 0x7fbb04198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb02ffd700 1 -- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 msgr2=0x7fbb04198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb02ffd700 1 -- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 msgr2=0x7fbb04198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb02ffd700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 0x7fbb04198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb02ffd700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 0x7fbb04198b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:30:04.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb03fff700 1 -- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 msgr2=0x7fbb04198b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb03fff700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 0x7fbb04198b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb03fff700 1 -- 172.21.15.102:0/3155810371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 msgr2=0x7fbb04198140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb03fff700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 0x7fbb04198140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.960+0000 7fbb03fff700 1 -- 172.21.15.102:0/3155810371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb041a3db0 con 0x7fbb041a11b0 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.961+0000 7fbb03fff700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb041a11b0 0x7fbb041a35a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00bd50 tx=0x7fbafc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.961+0000 7fbb00ff9700 1 -- 172.21.15.102:0/3155810371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc019070 con 0x7fbb041a11b0 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.961+0000 7fbb00ff9700 1 -- 172.21.15.102:0/3155810371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fbafc00cd10 con 0x7fbb041a11b0 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.961+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb041a40a0 con 0x7fbb041a11b0 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.961+0000 7fbb00ff9700 1 -- 172.21.15.102:0/3155810371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc012680 con 0x7fbb041a11b0 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.961+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb041a45e0 con 0x7fbb041a11b0 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.962+0000 7fbb00ff9700 1 -- 172.21.15.102:0/3155810371 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7fbafc01c070 con 0x7fbb041a11b0 2024-04-06T03:30:04.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.962+0000 7fbb00ff9700 1 --2- 172.21.15.102:0/3155810371 >> v2:172.21.15.47:6800/850698093 conn(0x7fbaf00392f0 0x7fbaf003b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:04.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.962+0000 7fbb00ff9700 1 -- 172.21.15.102:0/3155810371 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fbafc04c700 con 0x7fbb041a11b0 2024-04-06T03:30:04.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.962+0000 7fbb037fe700 1 --2- 172.21.15.102:0/3155810371 >> v2:172.21.15.47:6800/850698093 conn(0x7fbaf00392f0 0x7fbaf003b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:04.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.962+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb04063900 con 0x7fbb041a11b0 2024-04-06T03:30:04.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.962+0000 7fbb037fe700 1 --2- 172.21.15.102:0/3155810371 >> v2:172.21.15.47:6800/850698093 conn(0x7fbaf00392f0 0x7fbaf003b7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400fa40 tx=0x7fbaf4005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:04.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:04.967+0000 7fbb00ff9700 1 -- 172.21.15.102:0/3155810371 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fbafc00e0a0 con 0x7fbb041a11b0 2024-04-06T03:30:04.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:04 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:04.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:04 smithi047 ceph-mon[37680]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:04.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:04 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:04 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:04.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:04 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:04 smithi047 ceph-mon[29365]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:04 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:04 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:05.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:04 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:05.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:04 smithi102 ceph-mon[32821]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:05.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:04 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:05.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:04 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:30:05.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.245+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbb041a48a0 con 0x7fbb041a11b0 2024-04-06T03:30:05.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.245+0000 7fbb00ff9700 1 -- 172.21.15.102:0/3155810371 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7fbafc007290 con 0x7fbb041a11b0 2024-04-06T03:30:05.246 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-06T03:30:05.246 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":3,"fsid":"8f6329a8-f3c5-11ee-b649-cb9ed24678a4","modified":"2024-04-06T03:29:58.752957Z","created":"2024-04-06T03:28:08.062065Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3301","nonce":0},{"type":"v1","addr":"172.21.15.47:6790","nonce":0}]},"addr":"172.21.15.47:6790/0","public_addr":"172.21.15.47:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-06T03:30:05.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 >> v2:172.21.15.47:6800/850698093 conn(0x7fbaf00392f0 msgr2=0x7fbaf003b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:05.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 --2- 172.21.15.102:0/3155810371 >> v2:172.21.15.47:6800/850698093 conn(0x7fbaf00392f0 0x7fbaf003b7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400fa40 tx=0x7fbaf4005c00 comp rx=0 tx=0).stop 2024-04-06T03:30:05.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb041a11b0 msgr2=0x7fbb041a35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:05.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb041a11b0 0x7fbb041a35a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00bd50 tx=0x7fbafc00be30 comp rx=0 tx=0).stop 2024-04-06T03:30:05.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 shutdown_connections 2024-04-06T03:30:05.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 --2- 172.21.15.102:0/3155810371 >> v2:172.21.15.47:6800/850698093 conn(0x7fbaf00392f0 0x7fbaf003b7b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:05.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb041a11b0 0x7fbb041a35a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:05.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaec0062a0 0x7fbb04198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:05.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 --2- 172.21.15.102:0/3155810371 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb04198680 0x7fbb04198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:05.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 >> 172.21.15.102:0/3155810371 conn(0x7fbb040fc7e0 msgr2=0x7fbb04104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:05.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 shutdown_connections 2024-04-06T03:30:05.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:05.247+0000 7fbb09de5700 1 -- 172.21.15.102:0/3155810371 wait complete. 2024-04-06T03:30:05.248 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 3 2024-04-06T03:30:05.876 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-06T03:30:05.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-04-06T03:30:06.118 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:30:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/3155810371' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/3155810371' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:30:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/3155810371' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:07.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:07 smithi047 ceph-mon[29365]: Reconfiguring mon.a (unknown last config time)... 2024-04-06T03:30:07.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:07 smithi047 ceph-mon[29365]: Reconfiguring daemon mon.a on smithi047 2024-04-06T03:30:07.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:07 smithi047 ceph-mon[29365]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:07.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:07 smithi047 ceph-mon[37680]: Reconfiguring mon.a (unknown last config time)... 2024-04-06T03:30:07.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:07 smithi047 ceph-mon[37680]: Reconfiguring daemon mon.a on smithi047 2024-04-06T03:30:07.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:07 smithi047 ceph-mon[37680]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:07.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:07 smithi102 ceph-mon[32821]: Reconfiguring mon.a (unknown last config time)... 2024-04-06T03:30:07.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:07 smithi102 ceph-mon[32821]: Reconfiguring daemon mon.a on smithi047 2024-04-06T03:30:07.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:07 smithi102 ceph-mon[32821]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.395+0000 7febc85e2700 1 -- 172.21.15.47:0/1360459099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc0100e00 msgr2=0x7febc01011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.395+0000 7febc85e2700 1 --2- 172.21.15.47:0/1360459099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc0100e00 0x7febc01011e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7febb0009910 tx=0x7febb0009c20 comp rx=0 tx=0).stop 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.395+0000 7febc85e2700 1 -- 172.21.15.47:0/1360459099 shutdown_connections 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.395+0000 7febc85e2700 1 --2- 172.21.15.47:0/1360459099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc0100e00 0x7febc01011e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.395+0000 7febc85e2700 1 -- 172.21.15.47:0/1360459099 >> 172.21.15.47:0/1360459099 conn(0x7febc0077810 msgr2=0x7febc00feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.395+0000 7febc85e2700 1 -- 172.21.15.47:0/1360459099 shutdown_connections 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.395+0000 7febc85e2700 1 -- 172.21.15.47:0/1360459099 wait complete. 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc85e2700 1 Processor -- start 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc85e2700 1 -- start start 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc85e2700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7febc0100e00 0x7febc0197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc85e2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc0198520 0x7febc01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc85e2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc01a1050 0x7febc01a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc85e2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febc010a830 con 0x7febc01a1050 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc85e2700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7febc010a6b0 con 0x7febc0198520 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc85e2700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7febc010a9b0 con 0x7febc0100e00 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc6b7f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc01a1050 0x7febc01a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc637e700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7febc0100e00 0x7febc0197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc6b7f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc01a1050 0x7febc01a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52142/0 (socket says 172.21.15.47:52142) 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc6b7f700 1 -- 172.21.15.47:0/703810945 learned_addr learned my addr 172.21.15.47:0/703810945 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc637e700 1 -- 172.21.15.47:0/703810945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc0198520 msgr2=0x7febc01989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc5b7d700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc0198520 0x7febc01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc637e700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc0198520 0x7febc01989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc637e700 1 -- 172.21.15.47:0/703810945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc01a1050 msgr2=0x7febc01a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc637e700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc01a1050 0x7febc01a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc637e700 1 -- 172.21.15.47:0/703810945 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc01a3c50 con 0x7febc0100e00 2024-04-06T03:30:08.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.396+0000 7febc6b7f700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc01a1050 0x7febc01a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:30:08.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.397+0000 7febc5b7d700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc0198520 0x7febc01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-06T03:30:08.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.397+0000 7febc637e700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7febc0100e00 0x7febc0197fe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7febb0014000 tx=0x7febb0004f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:08.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.397+0000 7febb77fe700 1 -- 172.21.15.47:0/703810945 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0027070 con 0x7febc0100e00 2024-04-06T03:30:08.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.397+0000 7febb77fe700 1 -- 172.21.15.47:0/703810945 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7febb0005da0 con 0x7febc0100e00 2024-04-06T03:30:08.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.397+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc01a3f40 con 0x7febc0100e00 2024-04-06T03:30:08.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.397+0000 7febb77fe700 1 -- 172.21.15.47:0/703810945 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0022c60 con 0x7febc0100e00 2024-04-06T03:30:08.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.397+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7febc01a43a0 con 0x7febc0100e00 2024-04-06T03:30:08.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.398+0000 7febb77fe700 1 -- 172.21.15.47:0/703810945 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7febb002a070 con 0x7febc0100e00 2024-04-06T03:30:08.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.398+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc0063900 con 0x7febc0100e00 2024-04-06T03:30:08.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.398+0000 7febb77fe700 1 --2- 172.21.15.47:0/703810945 >> v2:172.21.15.47:6800/850698093 conn(0x7febac0392f0 0x7febac03b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:08.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.398+0000 7febb77fe700 1 -- 172.21.15.47:0/703810945 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7febb0022e00 con 0x7febc0100e00 2024-04-06T03:30:08.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.398+0000 7febc5b7d700 1 --2- 172.21.15.47:0/703810945 >> v2:172.21.15.47:6800/850698093 conn(0x7febac0392f0 0x7febac03b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:08.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.398+0000 7febc5b7d700 1 --2- 172.21.15.47:0/703810945 >> v2:172.21.15.47:6800/850698093 conn(0x7febac0392f0 0x7febac03b7b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7febbc0079b0 tx=0x7febbc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:08.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.403+0000 7febb77fe700 1 -- 172.21.15.47:0/703810945 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7febb0013070 con 0x7febc0100e00 2024-04-06T03:30:08.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.607+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7febc0069dd0 con 0x7febc0100e00 2024-04-06T03:30:08.609 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:08 smithi047 ceph-mon[29365]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:08.609 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:08 smithi047 ceph-mon[37680]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:08.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.607+0000 7febb77fe700 1 -- 172.21.15.47:0/703810945 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7febb0031020 con 0x7febc0100e00 2024-04-06T03:30:08.609 INFO:teuthology.orchestra.run.smithi047.stdout:# minimal ceph.conf for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:30:08.610 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-04-06T03:30:08.610 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:30:08.610 INFO:teuthology.orchestra.run.smithi047.stdout: mon_host = [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] 2024-04-06T03:30:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 >> v2:172.21.15.47:6800/850698093 conn(0x7febac0392f0 msgr2=0x7febac03b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 --2- 172.21.15.47:0/703810945 >> v2:172.21.15.47:6800/850698093 conn(0x7febac0392f0 0x7febac03b7b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7febbc0079b0 tx=0x7febbc008040 comp rx=0 tx=0).stop 2024-04-06T03:30:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7febc0100e00 msgr2=0x7febc0197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7febc0100e00 0x7febc0197fe0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7febb0014000 tx=0x7febb0004f80 comp rx=0 tx=0).stop 2024-04-06T03:30:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 shutdown_connections 2024-04-06T03:30:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 --2- 172.21.15.47:0/703810945 >> v2:172.21.15.47:6800/850698093 conn(0x7febac0392f0 0x7febac03b7b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc01a1050 0x7febc01a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:08.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7febc0100e00 0x7febc0197fe0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:08.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 --2- 172.21.15.47:0/703810945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc0198520 0x7febc01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:08.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 >> 172.21.15.47:0/703810945 conn(0x7febc0077810 msgr2=0x7febc0108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:08.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 shutdown_connections 2024-04-06T03:30:08.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:08.609+0000 7febc85e2700 1 -- 172.21.15.47:0/703810945 wait complete. 2024-04-06T03:30:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:08 smithi102 ceph-mon[32821]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:09.392 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-06T03:30:09.392 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:30:09.392 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-04-06T03:30:09.421 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:30:09.421 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:30:09.487 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:30:09.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.conf 2024-04-06T03:30:09.523 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:30:09.523 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/703810945' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[37680]: Reconfiguring mon.c (monmap changed)... 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[37680]: Reconfiguring daemon mon.c on smithi047 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/703810945' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:09.525 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:09.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:09.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[29365]: Reconfiguring mon.c (monmap changed)... 2024-04-06T03:30:09.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:09.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:09.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:09.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:09 smithi047 ceph-mon[29365]: Reconfiguring daemon mon.c on smithi047 2024-04-06T03:30:09.593 INFO:tasks.cephadm:Adding mgr.y on smithi047 2024-04-06T03:30:09.593 INFO:tasks.cephadm:Adding mgr.x on smithi102 2024-04-06T03:30:09.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch apply mgr '2;smithi047=y;smithi102=x' 2024-04-06T03:30:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/703810945' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:09 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:09 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:09 smithi102 ceph-mon[32821]: Reconfiguring mon.c (monmap changed)... 2024-04-06T03:30:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:09 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:09 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:09 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:09 smithi102 ceph-mon[32821]: Reconfiguring daemon mon.c on smithi047 2024-04-06T03:30:09.869 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:30:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:10 smithi102 ceph-mon[32821]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:10 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:10 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:10 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:10 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:10 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[29365]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:10.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:10.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[37680]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:10.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:10.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:10.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T03:30:10.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T03:30:10.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:10 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:11.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 -- 172.21.15.102:0/2534929491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c60100d30 msgr2=0x7f1c60101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:11.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 --2- 172.21.15.102:0/2534929491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c60100d30 0x7f1c60101150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009910 tx=0x7f1c54009c20 comp rx=0 tx=0).stop 2024-04-06T03:30:11.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 -- 172.21.15.102:0/2534929491 shutdown_connections 2024-04-06T03:30:11.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 --2- 172.21.15.102:0/2534929491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c60100d30 0x7f1c60101150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:11.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 -- 172.21.15.102:0/2534929491 >> 172.21.15.102:0/2534929491 conn(0x7f1c600fc2b0 msgr2=0x7f1c600fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:11.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 -- 172.21.15.102:0/2534929491 shutdown_connections 2024-04-06T03:30:11.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 -- 172.21.15.102:0/2534929491 wait complete. 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 Processor -- start 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.454+0000 7f1c66272700 1 -- start start 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c66272700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c60100d30 0x7f1c6006afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c66272700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c60199ac0 0x7f1c6019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c66272700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c6019c3f0 0x7f1c6019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c66272700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60106420 con 0x7f1c60100d30 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c66272700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601062a0 con 0x7f1c60199ac0 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c66272700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f1c601065a0 con 0x7f1c6019c3f0 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c60199ac0 0x7f1c6019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c60199ac0 0x7f1c6019beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41904/0 (socket says 172.21.15.102:41904) 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 -- 172.21.15.102:0/2068451363 learned_addr learned my addr 172.21.15.102:0/2068451363 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:30:11.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5ffff700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c60100d30 0x7f1c6006afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c6480f700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c6019c3f0 0x7f1c6019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 -- 172.21.15.102:0/2068451363 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c6019c3f0 msgr2=0x7f1c6019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c6019c3f0 0x7f1c6019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 -- 172.21.15.102:0/2068451363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c60100d30 msgr2=0x7f1c6006afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c60100d30 0x7f1c6006afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 -- 172.21.15.102:0/2068451363 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6019f150 con 0x7f1c60199ac0 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.455+0000 7f1c5f7fe700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c60199ac0 0x7f1c6019beb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000b780 tx=0x7f1c5000ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.456+0000 7f1c5d7fa700 1 -- 172.21.15.102:0/2068451363 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50016070 con 0x7f1c60199ac0 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.456+0000 7f1c5d7fa700 1 -- 172.21.15.102:0/2068451363 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f1c500036a0 con 0x7f1c60199ac0 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.456+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6019f440 con 0x7f1c60199ac0 2024-04-06T03:30:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.456+0000 7f1c5d7fa700 1 -- 172.21.15.102:0/2068451363 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c500119a0 con 0x7f1c60199ac0 2024-04-06T03:30:11.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.456+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6019fa00 con 0x7f1c60199ac0 2024-04-06T03:30:11.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.456+0000 7f1c5d7fa700 1 -- 172.21.15.102:0/2068451363 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7f1c50019070 con 0x7f1c60199ac0 2024-04-06T03:30:11.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.457+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c60063900 con 0x7f1c60199ac0 2024-04-06T03:30:11.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.457+0000 7f1c5d7fa700 1 --2- 172.21.15.102:0/2068451363 >> v2:172.21.15.47:6800/850698093 conn(0x7f1c480392f0 0x7f1c4803b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:11.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.457+0000 7f1c5d7fa700 1 -- 172.21.15.102:0/2068451363 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f1c5004a9b0 con 0x7f1c60199ac0 2024-04-06T03:30:11.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.457+0000 7f1c5ffff700 1 --2- 172.21.15.102:0/2068451363 >> v2:172.21.15.47:6800/850698093 conn(0x7f1c480392f0 0x7f1c4803b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:11.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.457+0000 7f1c5ffff700 1 --2- 172.21.15.102:0/2068451363 >> v2:172.21.15.47:6800/850698093 conn(0x7f1c480392f0 0x7f1c4803b7b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009750 tx=0x7f1c5401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:11.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.462+0000 7f1c5d7fa700 1 -- 172.21.15.102:0/2068451363 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1c50015170 con 0x7f1c60199ac0 2024-04-06T03:30:11.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:11 smithi102 ceph-mon[32821]: Reconfiguring mon.b (monmap changed)... 2024-04-06T03:30:11.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:11 smithi102 ceph-mon[32821]: Reconfiguring daemon mon.b on smithi102 2024-04-06T03:30:11.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.680+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi047=y;smithi102=x", "target": ["mon-mgr", ""]}) -- 0x7f1c6002dee0 con 0x7f1c480392f0 2024-04-06T03:30:11.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.686+0000 7f1c5d7fa700 1 -- 172.21.15.102:0/2068451363 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1c6002dee0 con 0x7f1c480392f0 2024-04-06T03:30:11.686 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mgr update... 2024-04-06T03:30:11.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 >> v2:172.21.15.47:6800/850698093 conn(0x7f1c480392f0 msgr2=0x7f1c4803b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:11.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 --2- 172.21.15.102:0/2068451363 >> v2:172.21.15.47:6800/850698093 conn(0x7f1c480392f0 0x7f1c4803b7b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009750 tx=0x7f1c5401a040 comp rx=0 tx=0).stop 2024-04-06T03:30:11.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c60199ac0 msgr2=0x7f1c6019beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:11.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c60199ac0 0x7f1c6019beb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000b780 tx=0x7f1c5000ba90 comp rx=0 tx=0).stop 2024-04-06T03:30:11.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 shutdown_connections 2024-04-06T03:30:11.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 --2- 172.21.15.102:0/2068451363 >> v2:172.21.15.47:6800/850698093 conn(0x7f1c480392f0 0x7f1c4803b7b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:11.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c6019c3f0 0x7f1c6019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:11.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c60100d30 0x7f1c6006afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:11.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 --2- 172.21.15.102:0/2068451363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c60199ac0 0x7f1c6019beb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:11.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 >> 172.21.15.102:0/2068451363 conn(0x7f1c600fc2b0 msgr2=0x7f1c600fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:11.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 shutdown_connections 2024-04-06T03:30:11.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:30:11.689+0000 7f1c66272700 1 -- 172.21.15.102:0/2068451363 wait complete. 2024-04-06T03:30:11.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:11 smithi047 ceph-mon[29365]: Reconfiguring mon.b (monmap changed)... 2024-04-06T03:30:11.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:11 smithi047 ceph-mon[29365]: Reconfiguring daemon mon.b on smithi102 2024-04-06T03:30:11.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:11 smithi047 ceph-mon[37680]: Reconfiguring mon.b (monmap changed)... 2024-04-06T03:30:11.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:11 smithi047 ceph-mon[37680]: Reconfiguring daemon mon.b on smithi102 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi047=y;smithi102=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: Saving service mgr spec with placement smithi047=y;smithi102=x;count:2 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:12.938 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T03:30:12.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-06T03:30:12.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T03:30:12.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:12.962 DEBUG:teuthology.orchestra.run.smithi102:mgr.x> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.x.service 2024-04-06T03:30:12.965 INFO:tasks.cephadm:Deploying OSDs... 2024-04-06T03:30:12.965 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:30:12.965 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-04-06T03:30:12.984 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-06T03:30:12.984 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-04-06T03:30:12.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi047=y;smithi102=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:12.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: Saving service mgr spec with placement smithi047=y;smithi102=x;count:2 2024-04-06T03:30:12.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:12.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:12.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi047=y;smithi102=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: Saving service mgr spec with placement smithi047=y;smithi102=x;count:2 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T03:30:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-06 03:29:58.182199120 +0000 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-06 03:24:11.824890306 +0000 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-06 03:24:11.824890306 +0000 2024-04-06T03:30:13.011 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-06 03:24:11.824890306 +0000 2024-04-06T03:30:13.011 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-06T03:30:13.080 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-06T03:30:13.080 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-06T03:30:13.080 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000105911 s, 4.8 MB/s 2024-04-06T03:30:13.081 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-06T03:30:13.139 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-06 03:29:58.182199120 +0000 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-06 03:24:12.165882705 +0000 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-06 03:24:12.165882705 +0000 2024-04-06T03:30:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-06 03:24:12.165882705 +0000 2024-04-06T03:30:13.197 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-06T03:30:13.265 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-06T03:30:13.265 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-06T03:30:13.265 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00011362 s, 4.5 MB/s 2024-04-06T03:30:13.266 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-06T03:30:13.323 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-04-06T03:30:13.379 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-06T03:30:13.379 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T03:30:13.379 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-06T03:30:13.379 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T03:30:13.379 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T03:30:13.380 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-06 03:29:58.183199097 +0000 2024-04-06T03:30:13.380 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-06 03:24:12.510875016 +0000 2024-04-06T03:30:13.380 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-06 03:24:12.510875016 +0000 2024-04-06T03:30:13.380 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-06 03:24:12.510875016 +0000 2024-04-06T03:30:13.380 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-06T03:30:13.446 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-06T03:30:13.446 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-06T03:30:13.446 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000107182 s, 4.8 MB/s 2024-04-06T03:30:13.448 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-06T03:30:13.505 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-04-06T03:30:13.560 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-06T03:30:13.560 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T03:30:13.561 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-06T03:30:13.561 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T03:30:13.561 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T03:30:13.561 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-06 03:29:58.183199097 +0000 2024-04-06T03:30:13.561 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-06 03:24:12.844867571 +0000 2024-04-06T03:30:13.561 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-06 03:24:12.844867571 +0000 2024-04-06T03:30:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-06 03:24:12.844867571 +0000 2024-04-06T03:30:13.561 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-06T03:30:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-06T03:30:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-06T03:30:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 9.6031e-05 s, 5.3 MB/s 2024-04-06T03:30:13.629 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-06T03:30:13.686 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:30:13.686 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-04-06T03:30:13.701 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-06T03:30:13.702 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-04-06T03:30:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-06T03:30:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T03:30:13.756 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-06T03:30:13.756 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T03:30:13.756 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T03:30:13.757 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-04-06 03:29:49.241550266 +0000 2024-04-06T03:30:13.757 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-06 03:24:09.493404831 +0000 2024-04-06T03:30:13.757 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-06 03:24:09.493404831 +0000 2024-04-06T03:30:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-04-06 03:24:09.493404831 +0000 2024-04-06T03:30:13.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-06T03:30:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-04-06T03:30:13.823 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-04-06T03:30:13.823 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000212705 s, 2.4 MB/s 2024-04-06T03:30:13.824 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-06T03:30:13.879 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-04-06T03:30:13.935 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-06T03:30:13.935 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T03:30:13.935 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-04-06T03:30:13.935 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T03:30:13.935 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T03:30:13.935 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-04-06 03:29:49.241550266 +0000 2024-04-06T03:30:13.936 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-06 03:24:09.850397549 +0000 2024-04-06T03:30:13.936 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-06 03:24:09.850397549 +0000 2024-04-06T03:30:13.936 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-04-06 03:24:09.850397549 +0000 2024-04-06T03:30:13.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-06T03:30:14.108 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-04-06T03:30:14.108 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-04-06T03:30:14.108 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.00024445 s, 2.1 MB/s 2024-04-06T03:30:14.109 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-06T03:30:14.124 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-04-06T03:30:14.185 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-06T03:30:14.185 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T03:30:14.185 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-06T03:30:14.185 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T03:30:14.185 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T03:30:14.185 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-04-06 03:30:14.062046636 +0000 2024-04-06T03:30:14.186 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-06 03:24:10.199390429 +0000 2024-04-06T03:30:14.186 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-06 03:24:10.199390429 +0000 2024-04-06T03:30:14.186 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-04-06 03:24:10.199390429 +0000 2024-04-06T03:30:14.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-06T03:30:14.289 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-04-06T03:30:14.289 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-04-06T03:30:14.289 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000200695 s, 2.6 MB/s 2024-04-06T03:30:14.290 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-06T03:30:14.305 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-04-06 03:30:14.247042877 +0000 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-06 03:24:10.539383494 +0000 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-06 03:24:10.539383494 +0000 2024-04-06T03:30:14.363 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-04-06 03:24:10.539383494 +0000 2024-04-06T03:30:14.363 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-06T03:30:14.427 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:14 smithi102 systemd[1]: Starting Ceph mgr.x for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:30:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-04-06T03:30:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-04-06T03:30:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000189538 s, 2.7 MB/s 2024-04-06T03:30:14.435 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-06T03:30:14.490 INFO:tasks.cephadm:Deploying osd.0 on smithi047 with /dev/vg_nvme/lv_4... 2024-04-06T03:30:14.490 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-06T03:30:14.731 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:14 smithi102 ceph-mon[32821]: Deploying daemon mgr.x on smithi102 2024-04-06T03:30:14.731 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:14 smithi102 podman[34618]: 2024-04-06 03:30:14.425331073 +0000 UTC m=+0.017903412 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T03:30:14.731 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:14 smithi102 podman[34618]: 2024-04-06 03:30:14.536405969 +0000 UTC m=+0.128978353 container create 753d5386e2ee8a32166177879f4fa3bf056136ecdb80e884e8a4a6f0fb13bedd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5) 2024-04-06T03:30:14.731 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:14 smithi102 podman[34618]: 2024-04-06 03:30:14.731214716 +0000 UTC m=+0.323787054 container init 753d5386e2ee8a32166177879f4fa3bf056136ecdb80e884e8a4a6f0fb13bedd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240403, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T03:30:14.738 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:30:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:14 smithi047 ceph-mon[29365]: Deploying daemon mgr.x on smithi102 2024-04-06T03:30:14.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:14 smithi047 ceph-mon[37680]: Deploying daemon mgr.x on smithi102 2024-04-06T03:30:15.083 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:14 smithi102 podman[34618]: 2024-04-06 03:30:14.734077156 +0000 UTC m=+0.326649497 container start 753d5386e2ee8a32166177879f4fa3bf056136ecdb80e884e8a4a6f0fb13bedd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-9f19235, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-06T03:30:15.083 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:14 smithi102 ceph-mgr[34674]: -- 172.21.15.102:0/2701061211 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566c38905a0 con 0x5566c3865000 2024-04-06T03:30:15.083 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:14 smithi102 bash[34618]: 753d5386e2ee8a32166177879f4fa3bf056136ecdb80e884e8a4a6f0fb13bedd 2024-04-06T03:30:15.083 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:14 smithi102 systemd[1]: Started Ceph mgr.x for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:30:15.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:15 smithi102 ceph-mon[32821]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:15.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:15 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:15 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:15 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:15 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:15 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:15.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:15 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:15.298+0000 7f2249c3b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-06T03:30:15.584 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:15 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:15.395+0000 7f2249c3b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-06T03:30:15.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[29365]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:15.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:15.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[37680]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:15.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:15.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:15 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:16.330 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:16.074+0000 7f2249c3b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-06T03:30:16.331 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:16.181+0000 7f2249c3b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-06T03:30:16.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:16.330+0000 7f2249c3b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-06T03:30:16.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:16.429+0000 7f2249c3b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-06T03:30:16.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:16.517+0000 7f2249c3b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-06T03:30:16.637 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-06T03:30:16.637 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-06T03:30:16.637 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-04-06T03:30:16.637 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-04-06T03:30:16.637 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00835746 s, 1.3 GB/s 2024-04-06T03:30:16.637 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-04-06T03:30:17.083 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:16.797+0000 7f2249c3b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-06T03:30:17.083 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:16.909+0000 7f2249c3b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-06T03:30:17.083 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:16.997+0000 7f2249c3b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: Reconfiguring mgr.y (unknown last config time)... 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:17.259 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: Reconfiguring daemon mgr.y on smithi047 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[37680]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: Reconfiguring mgr.y (unknown last config time)... 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: Reconfiguring daemon mgr.y on smithi047 2024-04-06T03:30:17.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:17 smithi047 ceph-mon[29365]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:17.261 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:17.093+0000 7f2249c3b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:17.275+0000 7f2249c3b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: Reconfiguring mgr.y (unknown last config time)... 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T03:30:17.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:17.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: Reconfiguring daemon mgr.y on smithi047 2024-04-06T03:30:17.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:17 smithi102 ceph-mon[32821]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:18.327 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:30:18.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:18.235+0000 7f2249c3b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-06T03:30:18.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:18.363+0000 7f2249c3b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-06T03:30:18.977 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:18.696+0000 7f2249c3b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-06T03:30:18.977 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:18.785+0000 7f2249c3b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-06T03:30:18.977 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:18.976+0000 7f2249c3b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:30:19.333 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:19.161+0000 7f2249c3b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-06T03:30:19.681 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.681 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.681 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[37680]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:19.681 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:19.681 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:19.681 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:19.681 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[29365]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:19.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:19.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:19.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:19.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-mon[32821]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:19.445+0000 7f2249c3b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:30:19.702 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:19.701+0000 7f2249c3b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-06T03:30:19.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 -- 172.21.15.47:0/3860908433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 msgr2=0x7fe5f4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 --2- 172.21.15.47:0/3860908433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 0x7fe5f4109650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009fc0 tx=0x7fe5ec00b330 comp rx=0 tx=0).stop 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 -- 172.21.15.47:0/3860908433 shutdown_connections 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 --2- 172.21.15.47:0/3860908433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 0x7fe5f4109650 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 --2- 172.21.15.47:0/3860908433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f4101200 0x7fe5f4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 --2- 172.21.15.47:0/3860908433 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5f4102400 0x7fe5f4102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 -- 172.21.15.47:0/3860908433 >> 172.21.15.47:0/3860908433 conn(0x7fe5f40fc7a0 msgr2=0x7fe5f40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 -- 172.21.15.47:0/3860908433 shutdown_connections 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.860+0000 7fe5fb047700 1 -- 172.21.15.47:0/3860908433 wait complete. 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5fb047700 1 Processor -- start 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5fb047700 1 -- start start 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5fb047700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5f4101200 0x7fe5f4197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5fb047700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f4102400 0x7fe5f41981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5fb047700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 0x7fe5f419f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5fb047700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f410c5c0 con 0x7fe5f4102da0 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5fb047700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f410c440 con 0x7fe5f4102400 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5fb047700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f410c740 con 0x7fe5f4101200 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f8de3700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5f4101200 0x7fe5f4197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f95e4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 0x7fe5f419f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f8de3700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5f4101200 0x7fe5f4197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:60934/0 (socket says 172.21.15.47:60934) 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f8de3700 1 -- 172.21.15.47:0/843533087 learned_addr learned my addr 172.21.15.47:0/843533087 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f4102400 0x7fe5f41981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f95e4700 1 -- 172.21.15.47:0/843533087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5f4101200 msgr2=0x7fe5f4197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f95e4700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5f4101200 0x7fe5f4197c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f95e4700 1 -- 172.21.15.47:0/843533087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f4102400 msgr2=0x7fe5f41981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f95e4700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f4102400 0x7fe5f41981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f95e4700 1 -- 172.21.15.47:0/843533087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f419f8e0 con 0x7fe5f4102da0 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f8de3700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5f4101200 0x7fe5f4197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:30:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.861+0000 7fe5f3fff700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f4102400 0x7fe5f41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:30:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.862+0000 7fe5f95e4700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 0x7fe5f419f210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00b6c0 tx=0x7fe5ec00cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.862+0000 7fe5f1ffb700 1 -- 172.21.15.47:0/843533087 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec021070 con 0x7fe5f4102da0 2024-04-06T03:30:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.862+0000 7fe5f1ffb700 1 -- 172.21.15.47:0/843533087 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe5ec007ac0 con 0x7fe5f4102da0 2024-04-06T03:30:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.862+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f419fb70 con 0x7fe5f4102da0 2024-04-06T03:30:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.862+0000 7fe5f1ffb700 1 -- 172.21.15.47:0/843533087 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec005040 con 0x7fe5f4102da0 2024-04-06T03:30:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.862+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f41a0070 con 0x7fe5f4102da0 2024-04-06T03:30:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.863+0000 7fe5f1ffb700 1 -- 172.21.15.47:0/843533087 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 46136+0+0 (secure 0 0 0) 0x7fe5ec024070 con 0x7fe5f4102da0 2024-04-06T03:30:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.863+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f4068f90 con 0x7fe5f4102da0 2024-04-06T03:30:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.863+0000 7fe5f1ffb700 1 --2- 172.21.15.47:0/843533087 >> v2:172.21.15.47:6800/850698093 conn(0x7fe5e40390a0 0x7fe5e403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.863+0000 7fe5f1ffb700 1 -- 172.21.15.47:0/843533087 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fe5ec00f020 con 0x7fe5f4102da0 2024-04-06T03:30:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.863+0000 7fe5f8de3700 1 --2- 172.21.15.47:0/843533087 >> v2:172.21.15.47:6800/850698093 conn(0x7fe5e40390a0 0x7fe5e403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.864+0000 7fe5f8de3700 1 --2- 172.21.15.47:0/843533087 >> v2:172.21.15.47:6800/850698093 conn(0x7fe5e40390a0 0x7fe5e403b560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4198b40 tx=0x7fe5e8007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:19.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:19.868+0000 7fe5f1ffb700 1 -- 172.21.15.47:0/843533087 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe5ec02b020 con 0x7fe5f4102da0 2024-04-06T03:30:20.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:20.079+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe5f40fe900 con 0x7fe5e40390a0 2024-04-06T03:30:20.082 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:19 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:19.934+0000 7f2249c3b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-06T03:30:20.799 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:20.799 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[29365]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:20.799 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:30:20.799 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:30:20.799 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:20.799 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[29365]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:20.799 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:20.799 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[37680]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:20.800 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:30:20.800 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:30:20.800 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:20.800 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:20 smithi047 ceph-mon[37680]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:20.833 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:20.727+0000 7f2249c3b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-06T03:30:20.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:20 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:20.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:20 smithi102 ceph-mon[32821]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:20.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:20 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:30:20.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:20 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:30:20.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:20 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:20.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:20 smithi102 ceph-mon[32821]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:21.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:21.289+0000 7f2249c3b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-06T03:30:21.583 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:21.385+0000 7f2249c3b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-06T03:30:21.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:21.669+0000 7fe5f1ffb700 1 -- 172.21.15.47:0/843533087 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 14) ==== 91681+0+0 (secure 0 0 0) 0x7fe5ec012cf0 con 0x7fe5f4102da0 2024-04-06T03:30:21.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[29365]: Standby manager daemon x started 2024-04-06T03:30:21.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[29365]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-06T03:30:21.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[29365]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T03:30:21.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[29365]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-06T03:30:21.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[29365]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T03:30:21.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[37680]: Standby manager daemon x started 2024-04-06T03:30:21.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[37680]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-06T03:30:21.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[37680]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T03:30:21.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[37680]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-06T03:30:21.909 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:21 smithi047 ceph-mon[37680]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T03:30:22.083 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:30:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:30:21.598+0000 7f2249c3b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-06T03:30:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:21 smithi102 ceph-mon[32821]: Standby manager daemon x started 2024-04-06T03:30:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:21 smithi102 ceph-mon[32821]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-06T03:30:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:21 smithi102 ceph-mon[32821]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T03:30:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:21 smithi102 ceph-mon[32821]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-06T03:30:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:21 smithi102 ceph-mon[32821]: from='mgr.? 172.21.15.102:0/59457638' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T03:30:22.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:22 smithi047 ceph-mon[29365]: mgrmap e14: y(active, since 67s), standbys: x 2024-04-06T03:30:22.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:22 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-06T03:30:22.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:22 smithi047 ceph-mon[29365]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:22.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:22 smithi047 ceph-mon[37680]: mgrmap e14: y(active, since 67s), standbys: x 2024-04-06T03:30:22.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:22 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-06T03:30:22.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:22 smithi047 ceph-mon[37680]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:23.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:22 smithi102 ceph-mon[32821]: mgrmap e14: y(active, since 67s), standbys: x 2024-04-06T03:30:23.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:22 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-06T03:30:23.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:22 smithi102 ceph-mon[32821]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:23.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3138136659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]: dispatch 2024-04-06T03:30:23.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]: dispatch 2024-04-06T03:30:23.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]': finished 2024-04-06T03:30:23.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[37680]: osdmap e5: 1 total, 0 up, 1 in 2024-04-06T03:30:23.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:23.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1665798133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:30:23.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3138136659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]: dispatch 2024-04-06T03:30:23.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]: dispatch 2024-04-06T03:30:23.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]': finished 2024-04-06T03:30:23.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[29365]: osdmap e5: 1 total, 0 up, 1 in 2024-04-06T03:30:23.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:23.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1665798133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:30:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3138136659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]: dispatch 2024-04-06T03:30:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]: dispatch 2024-04-06T03:30:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ec002d7-209e-4bd2-850f-4c843760e184"}]': finished 2024-04-06T03:30:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:23 smithi102 ceph-mon[32821]: osdmap e5: 1 total, 0 up, 1 in 2024-04-06T03:30:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:23 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1665798133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:30:24.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:24 smithi047 ceph-mon[29365]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:24.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:24 smithi047 ceph-mon[37680]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:25.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:24 smithi102 ceph-mon[32821]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:26.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:26 smithi047 ceph-mon[29365]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:26.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:26 smithi047 ceph-mon[37680]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:26.786 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:26 smithi102 ceph-mon[32821]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:28.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:28 smithi047 ceph-mon[29365]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:28.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:28 smithi047 ceph-mon[37680]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:28.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:28 smithi102 ceph-mon[32821]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:29.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:29 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T03:30:29.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:29 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:29.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:29 smithi102 ceph-mon[32821]: Deploying daemon osd.0 on smithi047 2024-04-06T03:30:29.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:29 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T03:30:29.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:29 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:29.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:29 smithi047 ceph-mon[29365]: Deploying daemon osd.0 on smithi047 2024-04-06T03:30:29.836 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:29 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T03:30:29.836 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:29 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:29.836 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:29 smithi047 ceph-mon[37680]: Deploying daemon osd.0 on smithi047 2024-04-06T03:30:30.652 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:30 smithi047 ceph-mon[29365]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:30.652 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:30 smithi047 ceph-mon[37680]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:30.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:30 smithi102 ceph-mon[32821]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:32.739 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:32 smithi047 ceph-mon[29365]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:32.739 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:32 smithi047 ceph-mon[37680]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:32.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:32 smithi102 ceph-mon[32821]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:34.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:34 smithi102 ceph-mon[32821]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:34.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:34.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:34.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:34.883 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:34 smithi047 ceph-mon[29365]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:34.883 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:34.883 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:34.883 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:34.883 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:34 smithi047 ceph-mon[37680]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:34.883 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:34.883 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:34.883 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:36.768 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:36 smithi047 ceph-mon[29365]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:36.769 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:36 smithi047 ceph-mon[37680]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:36.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:36 smithi102 ceph-mon[32821]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:37.694 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:37 smithi047 ceph-mon[29365]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-06T03:30:37.694 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:37 smithi047 ceph-mon[37680]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-06T03:30:37.731 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 0 on host 'smithi047' 2024-04-06T03:30:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.730+0000 7fe5f1ffb700 1 -- 172.21.15.47:0/843533087 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe5f40fe900 con 0x7fe5e40390a0 2024-04-06T03:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 >> v2:172.21.15.47:6800/850698093 conn(0x7fe5e40390a0 msgr2=0x7fe5e403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 --2- 172.21.15.47:0/843533087 >> v2:172.21.15.47:6800/850698093 conn(0x7fe5e40390a0 0x7fe5e403b560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4198b40 tx=0x7fe5e8007480 comp rx=0 tx=0).stop 2024-04-06T03:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 msgr2=0x7fe5f419f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 0x7fe5f419f210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00b6c0 tx=0x7fe5ec00cfa0 comp rx=0 tx=0).stop 2024-04-06T03:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 shutdown_connections 2024-04-06T03:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 --2- 172.21.15.47:0/843533087 >> v2:172.21.15.47:6800/850698093 conn(0x7fe5e40390a0 0x7fe5e403b560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f4102da0 0x7fe5f419f210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5f4101200 0x7fe5f4197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:37.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 --2- 172.21.15.47:0/843533087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f4102400 0x7fe5f41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:37.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 >> 172.21.15.47:0/843533087 conn(0x7fe5f40fc7a0 msgr2=0x7fe5f40fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:37.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 shutdown_connections 2024-04-06T03:30:37.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:37.732+0000 7fe5fb047700 1 -- 172.21.15.47:0/843533087 wait complete. 2024-04-06T03:30:38.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:37 smithi102 ceph-mon[32821]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-06T03:30:38.345 DEBUG:teuthology.orchestra.run.smithi047:osd.0> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.0.service 2024-04-06T03:30:38.347 INFO:tasks.cephadm:Deploying osd.1 on smithi047 with /dev/vg_nvme/lv_3... 2024-04-06T03:30:38.348 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-06T03:30:38.639 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:30:38.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-06T03:30:38.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: osdmap e6: 1 total, 0 up, 1 in 2024-04-06T03:30:38.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:30:38.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:38.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: osdmap e7: 1 total, 0 up, 1 in 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: osdmap e6: 1 total, 0 up, 1 in 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:30:38.951 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:38.952 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:38.952 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:38.952 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:38.952 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:38.952 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:38.952 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:30:38.952 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: osdmap e7: 1 total, 0 up, 1 in 2024-04-06T03:30:38.952 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:38.952 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0[41662]: 2024-04-06T03:30:38.635+0000 7ff479265700 -1 osd.0 0 waiting for initial osdmap 2024-04-06T03:30:38.952 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:30:38 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0[41662]: 2024-04-06T03:30:38.641+0000 7ff475058700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T03:30:39.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-06T03:30:39.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: osdmap e6: 1 total, 0 up, 1 in 2024-04-06T03:30:39.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:30:39.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='osd.0 v2:172.21.15.47:6801/1723574942' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:30:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: osdmap e7: 1 total, 0 up, 1 in 2024-04-06T03:30:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:39.712 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:39 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:39.712 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:39 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:39.712 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:39 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:39.712 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:39 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:40.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:39 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:40.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:39 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:40.508 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-06T03:30:40.508 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-06T03:30:40.508 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-04-06T03:30:40.508 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-04-06T03:30:40.508 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00939443 s, 1.1 GB/s 2024-04-06T03:30:40.508 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-04-06T03:30:40.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[29365]: purged_snaps scrub starts 2024-04-06T03:30:40.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[29365]: purged_snaps scrub ok 2024-04-06T03:30:40.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[29365]: osd.0 v2:172.21.15.47:6801/1723574942 boot 2024-04-06T03:30:40.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[29365]: osdmap e8: 1 total, 1 up, 1 in 2024-04-06T03:30:40.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:40.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[29365]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[37680]: purged_snaps scrub starts 2024-04-06T03:30:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[37680]: purged_snaps scrub ok 2024-04-06T03:30:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[37680]: osd.0 v2:172.21.15.47:6801/1723574942 boot 2024-04-06T03:30:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[37680]: osdmap e8: 1 total, 1 up, 1 in 2024-04-06T03:30:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:40 smithi047 ceph-mon[37680]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:41.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:40 smithi102 ceph-mon[32821]: purged_snaps scrub starts 2024-04-06T03:30:41.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:40 smithi102 ceph-mon[32821]: purged_snaps scrub ok 2024-04-06T03:30:41.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:40 smithi102 ceph-mon[32821]: osd.0 v2:172.21.15.47:6801/1723574942 boot 2024-04-06T03:30:41.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:40 smithi102 ceph-mon[32821]: osdmap e8: 1 total, 1 up, 1 in 2024-04-06T03:30:41.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:40 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:30:41.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:40 smithi102 ceph-mon[32821]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T03:30:41.408 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2024-04-06T03:30:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:30:42.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:42 smithi047 ceph-mon[29365]: osdmap e9: 1 total, 1 up, 1 in 2024-04-06T03:30:42.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:42 smithi047 ceph-mon[29365]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:42.898 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:42 smithi047 ceph-mon[37680]: osdmap e9: 1 total, 1 up, 1 in 2024-04-06T03:30:42.898 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:42 smithi047 ceph-mon[37680]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:43.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:42 smithi102 ceph-mon[32821]: osdmap e9: 1 total, 1 up, 1 in 2024-04-06T03:30:43.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:42 smithi102 ceph-mon[32821]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:44.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.705+0000 7fa06f924700 1 -- 172.21.15.47:0/1262951642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068101260 msgr2=0x7fa068101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:44.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.705+0000 7fa06f924700 1 --2- 172.21.15.47:0/1262951642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068101260 0x7fa068101680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0640099c0 tx=0x7fa064009cd0 comp rx=0 tx=0).stop 2024-04-06T03:30:44.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 -- 172.21.15.47:0/1262951642 shutdown_connections 2024-04-06T03:30:44.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 --2- 172.21.15.47:0/1262951642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa068102e00 0x7fa0681096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:44.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 --2- 172.21.15.47:0/1262951642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068101260 0x7fa068101680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:44.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 --2- 172.21.15.47:0/1262951642 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa068102460 0x7fa0681028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:44.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 -- 172.21.15.47:0/1262951642 >> 172.21.15.47:0/1262951642 conn(0x7fa0680fc820 msgr2=0x7fa0680fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:30:44.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 -- 172.21.15.47:0/1262951642 shutdown_connections 2024-04-06T03:30:44.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 -- 172.21.15.47:0/1262951642 wait complete. 2024-04-06T03:30:44.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 Processor -- start 2024-04-06T03:30:44.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.706+0000 7fa06f924700 1 -- start start 2024-04-06T03:30:44.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06f924700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa068101260 0x7fa068196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06f924700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa068102460 0x7fa068197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06f924700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068102e00 0x7fa06819e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06f924700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa06810c520 con 0x7fa068102e00 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06f924700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa06810c3a0 con 0x7fa068102460 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06f924700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa06810c6a0 con 0x7fa068101260 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa068101260 0x7fa068196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06dec1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068102e00 0x7fa06819e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa068101260 0x7fa068196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:53320/0 (socket says 172.21.15.47:53320) 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 -- 172.21.15.47:0/1844571674 learned_addr learned my addr 172.21.15.47:0/1844571674 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06cebf700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa068102460 0x7fa068197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 -- 172.21.15.47:0/1844571674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa068102460 msgr2=0x7fa068197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa068102460 0x7fa068197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 -- 172.21.15.47:0/1844571674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068102e00 msgr2=0x7fa06819e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068102e00 0x7fa06819e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:30:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 -- 172.21.15.47:0/1844571674 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06819e740 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06dec1700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068102e00 0x7fa06819e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa06d6c0700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa068101260 0x7fa068196ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa064003e90 tx=0x7fa064003ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.707+0000 7fa05e7fc700 1 -- 172.21.15.47:0/1844571674 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064009e60 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.708+0000 7fa05e7fc700 1 -- 172.21.15.47:0/1844571674 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fa06400f460 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.708+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06819e9d0 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.708+0000 7fa05e7fc700 1 -- 172.21.15.47:0/1844571674 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064017650 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.708+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06819ee20 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.708+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068068f90 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.709+0000 7fa05e7fc700 1 -- 172.21.15.47:0/1844571674 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 14) ==== 91681+0+0 (secure 0 0 0) 0x7fa0640052d0 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.709+0000 7fa05e7fc700 1 --2- 172.21.15.47:0/1844571674 >> v2:172.21.15.47:6800/850698093 conn(0x7fa05406da80 0x7fa05406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.709+0000 7fa06cebf700 1 --2- 172.21.15.47:0/1844571674 >> v2:172.21.15.47:6800/850698093 conn(0x7fa05406da80 0x7fa05406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.709+0000 7fa05e7fc700 1 -- 172.21.15.47:0/1844571674 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1541+0+0 (secure 0 0 0) 0x7fa06408d580 con 0x7fa068101260 2024-04-06T03:30:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.710+0000 7fa06cebf700 1 --2- 172.21.15.47:0/1844571674 >> v2:172.21.15.47:6800/850698093 conn(0x7fa05406da80 0x7fa05406ff40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa058009c60 tx=0x7fa058009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:30:44.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.714+0000 7fa05e7fc700 1 -- 172.21.15.47:0/1844571674 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa064013070 con 0x7fa068101260 2024-04-06T03:30:44.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:30:44.929+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa068062710 con 0x7fa05406da80 2024-04-06T03:30:45.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: Detected new or changed devices on smithi047 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi047 to 16069M 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:30:45.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: Detected new or changed devices on smithi047 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi047 to 16069M 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:30:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:30:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: Detected new or changed devices on smithi047 2024-04-06T03:30:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:30:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi047 to 16069M 2024-04-06T03:30:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:30:45.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:46 smithi047 ceph-mon[29365]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:46 smithi047 ceph-mon[37680]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:46 smithi102 ceph-mon[32821]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:30:47.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:47 smithi047 ceph-mon[29365]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:47.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:47 smithi047 ceph-mon[37680]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:47.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:47 smithi102 ceph-mon[32821]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2909527541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]: dispatch 2024-04-06T03:30:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]: dispatch 2024-04-06T03:30:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]': finished 2024-04-06T03:30:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[37680]: osdmap e10: 2 total, 1 up, 2 in 2024-04-06T03:30:48.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:30:48.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3533406871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:30:48.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2909527541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]: dispatch 2024-04-06T03:30:48.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]: dispatch 2024-04-06T03:30:48.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]': finished 2024-04-06T03:30:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[29365]: osdmap e10: 2 total, 1 up, 2 in 2024-04-06T03:30:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:30:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3533406871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:30:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2909527541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]: dispatch 2024-04-06T03:30:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]: dispatch 2024-04-06T03:30:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9e6ac29-f4e4-4811-a9a7-d206e26183bd"}]': finished 2024-04-06T03:30:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:48 smithi102 ceph-mon[32821]: osdmap e10: 2 total, 1 up, 2 in 2024-04-06T03:30:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:48 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:30:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3533406871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:30:49.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:49 smithi047 ceph-mon[29365]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:49.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:49 smithi047 ceph-mon[37680]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:49.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:49 smithi102 ceph-mon[32821]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:50.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:50 smithi047 ceph-mon[29365]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:50.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:50 smithi047 ceph-mon[37680]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:50.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:50 smithi102 ceph-mon[32821]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:52.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:52 smithi047 ceph-mon[29365]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:52.811 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:52 smithi047 ceph-mon[37680]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:52.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:52 smithi102 ceph-mon[32821]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:54.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:54 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T03:30:54.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:54 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:54 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T03:30:54.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:54 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:54 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T03:30:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:54 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:30:55.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:55 smithi047 ceph-mon[29365]: Deploying daemon osd.1 on smithi047 2024-04-06T03:30:55.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:55 smithi047 ceph-mon[29365]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:55.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:55 smithi047 ceph-mon[37680]: Deploying daemon osd.1 on smithi047 2024-04-06T03:30:55.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:55 smithi047 ceph-mon[37680]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:55.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:55 smithi102 ceph-mon[32821]: Deploying daemon osd.1 on smithi047 2024-04-06T03:30:55.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:55 smithi102 ceph-mon[32821]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:56.766 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:56 smithi047 ceph-mon[29365]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:56.766 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:56 smithi047 ceph-mon[37680]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:56.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:56 smithi102 ceph-mon[32821]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:58.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:30:58 smithi047 ceph-mon[29365]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:58.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:30:58 smithi047 ceph-mon[37680]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:30:58.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:30:58 smithi102 ceph-mon[32821]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:00.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:00 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:00 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:00 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:00.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:00 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:00.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:00 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:00.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:00 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:00.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:00 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:00.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:00 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:00.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:00 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:01.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:01 smithi047 ceph-mon[29365]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:01.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:01 smithi047 ceph-mon[37680]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:01.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:01 smithi102 ceph-mon[32821]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:03.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.155+0000 7fa05e7fc700 1 -- 172.21.15.47:0/1844571674 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa068062710 con 0x7fa05406da80 2024-04-06T03:31:03.156 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 1 on host 'smithi047' 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 >> v2:172.21.15.47:6800/850698093 conn(0x7fa05406da80 msgr2=0x7fa05406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 --2- 172.21.15.47:0/1844571674 >> v2:172.21.15.47:6800/850698093 conn(0x7fa05406da80 0x7fa05406ff40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa058009c60 tx=0x7fa058009260 comp rx=0 tx=0).stop 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa068101260 msgr2=0x7fa068196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa068101260 0x7fa068196ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa064003e90 tx=0x7fa064003ec0 comp rx=0 tx=0).stop 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 shutdown_connections 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 --2- 172.21.15.47:0/1844571674 >> v2:172.21.15.47:6800/850698093 conn(0x7fa05406da80 0x7fa05406ff40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa068102e00 0x7fa06819e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa068101260 0x7fa068196ae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:03.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 --2- 172.21.15.47:0/1844571674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa068102460 0x7fa068197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:03.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 >> 172.21.15.47:0/1844571674 conn(0x7fa0680fc820 msgr2=0x7fa068105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:31:03.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 shutdown_connections 2024-04-06T03:31:03.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:03.157+0000 7fa06f924700 1 -- 172.21.15.47:0/1844571674 wait complete. 2024-04-06T03:31:03.605 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.605 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.605 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:03.605 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:03.605 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.605 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:03.605 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-06T03:31:03.605 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-06T03:31:03.606 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.607 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.607 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:03.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-06T03:31:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:03.923 DEBUG:teuthology.orchestra.run.smithi047:osd.1> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.1.service 2024-04-06T03:31:03.926 INFO:tasks.cephadm:Deploying osd.2 on smithi047 with /dev/vg_nvme/lv_2... 2024-04-06T03:31:03.926 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-06T03:31:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-mon[29365]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-06T03:31:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-mon[29365]: osdmap e11: 2 total, 1 up, 2 in 2024-04-06T03:31:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-mon[29365]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:04.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-mon[37680]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-06T03:31:04.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-mon[37680]: osdmap e11: 2 total, 1 up, 2 in 2024-04-06T03:31:04.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-mon[37680]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:04.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:04.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:04 smithi102 ceph-mon[32821]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-06T03:31:04.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:04 smithi102 ceph-mon[32821]: osdmap e11: 2 total, 1 up, 2 in 2024-04-06T03:31:04.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:04 smithi102 ceph-mon[32821]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:04.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:04 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:04.953 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1[47247]: 2024-04-06T03:31:04.633+0000 7ffa201d9700 -1 osd.1 0 waiting for initial osdmap 2024-04-06T03:31:04.954 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:04 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1[47247]: 2024-04-06T03:31:04.636+0000 7ffa17fc4700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T03:31:04.963 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:31:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[29365]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[29365]: osdmap e12: 2 total, 1 up, 2 in 2024-04-06T03:31:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[29365]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[29365]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[37680]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[37680]: osdmap e12: 2 total, 1 up, 2 in 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[37680]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[37680]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' 2024-04-06T03:31:05.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:05 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:05.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:05 smithi102 ceph-mon[32821]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:05.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:05 smithi102 ceph-mon[32821]: osdmap e12: 2 total, 1 up, 2 in 2024-04-06T03:31:05.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:05 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:05 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:05 smithi102 ceph-mon[32821]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-06T03:31:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:05 smithi102 ceph-mon[32821]: from='osd.1 v2:172.21.15.47:6805/1617120903' entity='osd.1' 2024-04-06T03:31:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:05 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:06.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[29365]: purged_snaps scrub starts 2024-04-06T03:31:06.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[29365]: purged_snaps scrub ok 2024-04-06T03:31:06.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[29365]: osd.1 v2:172.21.15.47:6805/1617120903 boot 2024-04-06T03:31:06.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[29365]: osdmap e13: 2 total, 2 up, 2 in 2024-04-06T03:31:06.708 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:06.708 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[37680]: purged_snaps scrub starts 2024-04-06T03:31:06.708 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[37680]: purged_snaps scrub ok 2024-04-06T03:31:06.708 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[37680]: osd.1 v2:172.21.15.47:6805/1617120903 boot 2024-04-06T03:31:06.708 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[37680]: osdmap e13: 2 total, 2 up, 2 in 2024-04-06T03:31:06.708 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:06.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:06 smithi102 ceph-mon[32821]: purged_snaps scrub starts 2024-04-06T03:31:06.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:06 smithi102 ceph-mon[32821]: purged_snaps scrub ok 2024-04-06T03:31:06.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:06 smithi102 ceph-mon[32821]: osd.1 v2:172.21.15.47:6805/1617120903 boot 2024-04-06T03:31:06.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:06 smithi102 ceph-mon[32821]: osdmap e13: 2 total, 2 up, 2 in 2024-04-06T03:31:06.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:31:07.704 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:07 smithi047 ceph-mon[29365]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:07.704 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:07 smithi047 ceph-mon[37680]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:07.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:07 smithi102 ceph-mon[32821]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:08.053 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-06T03:31:08.053 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-06T03:31:08.053 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-04-06T03:31:08.053 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-04-06T03:31:08.053 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00829268 s, 1.3 GB/s 2024-04-06T03:31:08.053 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: osdmap e14: 2 total, 2 up, 2 in 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: osdmap e14: 2 total, 2 up, 2 in 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.776 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2024-04-06T03:31:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: osdmap e14: 2 total, 2 up, 2 in 2024-04-06T03:31:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:08.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:08.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:09.027 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:31:09.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:09 smithi047 ceph-mon[29365]: Detected new or changed devices on smithi047 2024-04-06T03:31:09.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:09 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi047 to 8034M 2024-04-06T03:31:09.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:09 smithi047 ceph-mon[29365]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:09.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:09 smithi047 ceph-mon[37680]: Detected new or changed devices on smithi047 2024-04-06T03:31:09.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:09 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi047 to 8034M 2024-04-06T03:31:09.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:09 smithi047 ceph-mon[37680]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:09 smithi102 ceph-mon[32821]: Detected new or changed devices on smithi047 2024-04-06T03:31:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:09 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi047 to 8034M 2024-04-06T03:31:09.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:09 smithi102 ceph-mon[32821]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 -- 172.21.15.47:0/3822577598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 msgr2=0x7f50f010a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/3822577598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 0x7f50f010a460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f50e800b0a0 tx=0x7f50e800b3b0 comp rx=0 tx=0).stop 2024-04-06T03:31:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 -- 172.21.15.47:0/3822577598 shutdown_connections 2024-04-06T03:31:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/3822577598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 0x7f50f010a460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/3822577598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f0102df0 0x7f50f01051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/3822577598 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50f0105720 0x7f50f0107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 -- 172.21.15.47:0/3822577598 >> 172.21.15.47:0/3822577598 conn(0x7f50f00fc7a0 msgr2=0x7f50f00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 -- 172.21.15.47:0/3822577598 shutdown_connections 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.463+0000 7f50f4f6f700 1 -- 172.21.15.47:0/3822577598 wait complete. 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50f4f6f700 1 Processor -- start 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50f4f6f700 1 -- start start 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50f4f6f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f0102df0 0x7f50f0197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50f4f6f700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50f0105720 0x7f50f0198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50f4f6f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 0x7f50f019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50f4f6f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50f010d620 con 0x7f50f0108050 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50f4f6f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f50f010d4a0 con 0x7f50f0102df0 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50f4f6f700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f50f010d7a0 con 0x7f50f0105720 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50eed9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 0x7f50f019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50edd9b700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50f0105720 0x7f50f0198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50eed9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 0x7f50f019f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44794/0 (socket says 172.21.15.47:44794) 2024-04-06T03:31:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50eed9d700 1 -- 172.21.15.47:0/2712419914 learned_addr learned my addr 172.21.15.47:0/2712419914 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50ee59c700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f0102df0 0x7f50f0197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50eed9d700 1 -- 172.21.15.47:0/2712419914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50f0105720 msgr2=0x7f50f0198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50eed9d700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50f0105720 0x7f50f0198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50eed9d700 1 -- 172.21.15.47:0/2712419914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f0102df0 msgr2=0x7f50f0197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50eed9d700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f0102df0 0x7f50f0197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50eed9d700 1 -- 172.21.15.47:0/2712419914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f019f840 con 0x7f50f0108050 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50ee59c700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f0102df0 0x7f50f0197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.464+0000 7f50edd9b700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50f0105720 0x7f50f0198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.465+0000 7f50eed9d700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 0x7f50f019f1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f50e8006070 tx=0x7f50e8004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.465+0000 7f50df7fe700 1 -- 172.21.15.47:0/2712419914 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8021070 con 0x7f50f0108050 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.465+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f019fad0 con 0x7f50f0108050 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.465+0000 7f50df7fe700 1 -- 172.21.15.47:0/2712419914 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f50e8007c00 con 0x7f50f0108050 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.465+0000 7f50df7fe700 1 -- 172.21.15.47:0/2712419914 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e80048b0 con 0x7f50f0108050 2024-04-06T03:31:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.465+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f019ffd0 con 0x7f50f0108050 2024-04-06T03:31:10.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.466+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f0068f90 con 0x7f50f0108050 2024-04-06T03:31:10.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.466+0000 7f50df7fe700 1 -- 172.21.15.47:0/2712419914 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) ==== 91681+0+0 (secure 0 0 0) 0x7f50e8003a00 con 0x7f50f0108050 2024-04-06T03:31:10.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.467+0000 7f50df7fe700 1 --2- 172.21.15.47:0/2712419914 >> v2:172.21.15.47:6800/850698093 conn(0x7f50d806da80 0x7f50d806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:31:10.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.467+0000 7f50ee59c700 1 --2- 172.21.15.47:0/2712419914 >> v2:172.21.15.47:6800/850698093 conn(0x7f50d806da80 0x7f50d806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:31:10.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.467+0000 7f50df7fe700 1 -- 172.21.15.47:0/2712419914 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 1833+0+0 (secure 0 0 0) 0x7f50e800f020 con 0x7f50f0108050 2024-04-06T03:31:10.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.467+0000 7f50ee59c700 1 --2- 172.21.15.47:0/2712419914 >> v2:172.21.15.47:6800/850698093 conn(0x7f50d806da80 0x7f50d806ff40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f50e0005950 tx=0x7f50e0005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:31:10.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.472+0000 7f50df7fe700 1 -- 172.21.15.47:0/2712419914 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f50e802a020 con 0x7f50f0108050 2024-04-06T03:31:10.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:10.685+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f50f002de30 con 0x7f50d806da80 2024-04-06T03:31:10.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:10 smithi102 ceph-mon[32821]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:10.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:10 smithi047 ceph-mon[29365]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:10.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:10 smithi047 ceph-mon[37680]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:11.578 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:11 smithi047 ceph-mon[29365]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:31:11.578 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:11 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:31:11.579 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:11 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:31:11.579 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:11 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:11.579 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:11 smithi047 ceph-mon[37680]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:31:11.579 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:11 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:31:11.579 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:11 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:31:11.579 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:11 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:11.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:11 smithi102 ceph-mon[32821]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:31:11.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:11 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:31:11.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:11 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:31:11.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:11 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:12.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:12 smithi047 ceph-mon[29365]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:12.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:12 smithi047 ceph-mon[37680]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:12.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:12 smithi102 ceph-mon[32821]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:13.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/193011865' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00d98fac-1ce6-4422-98e6-d1ad99cdfaf9"}]: dispatch 2024-04-06T03:31:13.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/193011865' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00d98fac-1ce6-4422-98e6-d1ad99cdfaf9"}]': finished 2024-04-06T03:31:13.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:13 smithi102 ceph-mon[32821]: osdmap e15: 3 total, 2 up, 3 in 2024-04-06T03:31:13.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:13.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/193011865' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00d98fac-1ce6-4422-98e6-d1ad99cdfaf9"}]: dispatch 2024-04-06T03:31:13.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/193011865' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00d98fac-1ce6-4422-98e6-d1ad99cdfaf9"}]': finished 2024-04-06T03:31:13.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:13 smithi047 ceph-mon[29365]: osdmap e15: 3 total, 2 up, 3 in 2024-04-06T03:31:13.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:13.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/193011865' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00d98fac-1ce6-4422-98e6-d1ad99cdfaf9"}]: dispatch 2024-04-06T03:31:13.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/193011865' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00d98fac-1ce6-4422-98e6-d1ad99cdfaf9"}]': finished 2024-04-06T03:31:13.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:13 smithi047 ceph-mon[37680]: osdmap e15: 3 total, 2 up, 3 in 2024-04-06T03:31:13.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:14.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1563179894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:31:14.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:14 smithi102 ceph-mon[32821]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:14.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1563179894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:31:14.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:14 smithi047 ceph-mon[29365]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:14.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1563179894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:31:14.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:14 smithi047 ceph-mon[37680]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:16.832 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:16 smithi047 ceph-mon[29365]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:16.832 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:16 smithi047 ceph-mon[37680]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:16.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:16 smithi102 ceph-mon[32821]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:18.666 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:18 smithi047 ceph-mon[29365]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:18.666 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:18 smithi047 ceph-mon[37680]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:18.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:18 smithi102 ceph-mon[32821]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:20.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T03:31:20.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T03:31:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T03:31:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:20.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:20 smithi047 ceph-mon[37680]: Deploying daemon osd.2 on smithi047 2024-04-06T03:31:21.019 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:20 smithi047 ceph-mon[37680]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:21.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:20 smithi047 ceph-mon[29365]: Deploying daemon osd.2 on smithi047 2024-04-06T03:31:21.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:20 smithi047 ceph-mon[29365]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:21.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:20 smithi102 ceph-mon[32821]: Deploying daemon osd.2 on smithi047 2024-04-06T03:31:21.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:20 smithi102 ceph-mon[32821]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:22.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:22 smithi102 ceph-mon[32821]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:22.866 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:22 smithi047 ceph-mon[29365]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:22.866 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:22 smithi047 ceph-mon[37680]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:24.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:24 smithi047 ceph-mon[29365]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:24.625 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:24 smithi047 ceph-mon[37680]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:24.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:24 smithi102 ceph-mon[32821]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:26.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:26 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:26.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:26 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:26.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:26 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:26 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:26 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:26 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:27.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:27 smithi047 ceph-mon[29365]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:27.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:27 smithi047 ceph-mon[37680]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:27.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:27 smithi102 ceph-mon[32821]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:28.988 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 2 on host 'smithi047' 2024-04-06T03:31:28.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.987+0000 7f50df7fe700 1 -- 172.21.15.47:0/2712419914 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f50f002de30 con 0x7f50d806da80 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.990+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 >> v2:172.21.15.47:6800/850698093 conn(0x7f50d806da80 msgr2=0x7f50d806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.990+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/2712419914 >> v2:172.21.15.47:6800/850698093 conn(0x7f50d806da80 0x7f50d806ff40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f50e0005950 tx=0x7f50e0005f50 comp rx=0 tx=0).stop 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.990+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 msgr2=0x7f50f019f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.990+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 0x7f50f019f1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f50e8006070 tx=0x7f50e8004d70 comp rx=0 tx=0).stop 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.990+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 shutdown_connections 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.990+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/2712419914 >> v2:172.21.15.47:6800/850698093 conn(0x7f50d806da80 0x7f50d806ff40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.990+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0108050 0x7f50f019f1a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.991+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f0102df0 0x7f50f0197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.991+0000 7f50f4f6f700 1 --2- 172.21.15.47:0/2712419914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50f0105720 0x7f50f0198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:28.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.991+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 >> 172.21.15.47:0/2712419914 conn(0x7f50f00fc7a0 msgr2=0x7f50f01036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:31:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.991+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 shutdown_connections 2024-04-06T03:31:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:28.991+0000 7f50f4f6f700 1 -- 172.21.15.47:0/2712419914 wait complete. 2024-04-06T03:31:29.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[29365]: from='osd.2 v2:172.21.15.47:6809/1442630653' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[29365]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[29365]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[37680]: from='osd.2 v2:172.21.15.47:6809/1442630653' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[37680]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[37680]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:29 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:29 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:29 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:29 smithi102 ceph-mon[32821]: from='osd.2 v2:172.21.15.47:6809/1442630653' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T03:31:29.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:29 smithi102 ceph-mon[32821]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T03:31:29.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:29 smithi102 ceph-mon[32821]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:29.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:29 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:29 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:29.650 DEBUG:teuthology.orchestra.run.smithi047:osd.2> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.2.service 2024-04-06T03:31:29.652 INFO:tasks.cephadm:Deploying osd.3 on smithi047 with /dev/vg_nvme/lv_1... 2024-04-06T03:31:29.652 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-06T03:31:30.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[29365]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-06T03:31:30.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[29365]: osdmap e16: 3 total, 2 up, 3 in 2024-04-06T03:31:30.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:30.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[29365]: from='osd.2 v2:172.21.15.47:6809/1442630653' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:30.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[29365]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[37680]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-06T03:31:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[37680]: osdmap e16: 3 total, 2 up, 3 in 2024-04-06T03:31:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[37680]: from='osd.2 v2:172.21.15.47:6809/1442630653' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-mon[37680]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:30 smithi102 ceph-mon[32821]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-06T03:31:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:30 smithi102 ceph-mon[32821]: osdmap e16: 3 total, 2 up, 3 in 2024-04-06T03:31:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:30 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:30 smithi102 ceph-mon[32821]: from='osd.2 v2:172.21.15.47:6809/1442630653' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:30 smithi102 ceph-mon[32821]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:30.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2[53300]: 2024-04-06T03:31:30.334+0000 7feebb7dc700 -1 osd.2 0 waiting for initial osdmap 2024-04-06T03:31:30.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2[53300]: 2024-04-06T03:31:30.337+0000 7feeb35c7700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T03:31:31.284 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:31:31.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:31 smithi102 ceph-mon[32821]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:31.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:31 smithi102 ceph-mon[32821]: osdmap e17: 3 total, 2 up, 3 in 2024-04-06T03:31:31.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:31 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:31.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:31 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:31.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:31 smithi102 ceph-mon[32821]: from='osd.2 ' entity='osd.2' 2024-04-06T03:31:31.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:31 smithi102 ceph-mon[32821]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:31.406 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[37680]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:31.406 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[37680]: osdmap e17: 3 total, 2 up, 3 in 2024-04-06T03:31:31.406 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:31.406 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:31.406 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[37680]: from='osd.2 ' entity='osd.2' 2024-04-06T03:31:31.406 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[37680]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:31.407 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[29365]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:31.407 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[29365]: osdmap e17: 3 total, 2 up, 3 in 2024-04-06T03:31:31.407 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:31.407 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:31.407 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[29365]: from='osd.2 ' entity='osd.2' 2024-04-06T03:31:31.407 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:31 smithi047 ceph-mon[29365]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-06T03:31:32.324 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[29365]: purged_snaps scrub starts 2024-04-06T03:31:32.324 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[29365]: purged_snaps scrub ok 2024-04-06T03:31:32.324 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:32.324 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[29365]: osd.2 v2:172.21.15.47:6809/1442630653 boot 2024-04-06T03:31:32.324 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[29365]: osdmap e18: 3 total, 3 up, 3 in 2024-04-06T03:31:32.324 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:32.325 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[37680]: purged_snaps scrub starts 2024-04-06T03:31:32.325 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[37680]: purged_snaps scrub ok 2024-04-06T03:31:32.325 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:32.325 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[37680]: osd.2 v2:172.21.15.47:6809/1442630653 boot 2024-04-06T03:31:32.325 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[37680]: osdmap e18: 3 total, 3 up, 3 in 2024-04-06T03:31:32.325 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:32 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:32 smithi102 ceph-mon[32821]: purged_snaps scrub starts 2024-04-06T03:31:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:32 smithi102 ceph-mon[32821]: purged_snaps scrub ok 2024-04-06T03:31:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:32 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:32 smithi102 ceph-mon[32821]: osd.2 v2:172.21.15.47:6809/1442630653 boot 2024-04-06T03:31:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:32 smithi102 ceph-mon[32821]: osdmap e18: 3 total, 3 up, 3 in 2024-04-06T03:31:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:32 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:31:33.238 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:33 smithi047 ceph-mon[29365]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:33.238 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:33 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:31:33.238 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:33 smithi047 ceph-mon[37680]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:33.238 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:33 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:31:33.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:33 smithi102 ceph-mon[32821]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:33.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:33 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:31:33.899 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-06T03:31:33.899 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-06T03:31:33.899 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-04-06T03:31:33.899 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-04-06T03:31:33.899 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00852367 s, 1.2 GB/s 2024-04-06T03:31:33.899 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-04-06T03:31:34.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: osdmap e19: 3 total, 3 up, 3 in 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: Detected new or changed devices on smithi047 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi047 to 5356M 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: osdmap e19: 3 total, 3 up, 3 in 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: Detected new or changed devices on smithi047 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi047 to 5356M 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: osdmap e19: 3 total, 3 up, 3 in 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: Detected new or changed devices on smithi047 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi047 to 5356M 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:34.578 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57336]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-06T03:31:34.578 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57336]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:34.578 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57336]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:34.578 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57336]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:34.604 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi047:vg_nvme/lv_1 2024-04-06T03:31:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:31:34.963 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57357]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-06T03:31:34.963 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57357]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:34.963 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57357]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:34.963 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57357]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:35.214 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:35 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-06T03:31:35.214 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:35 smithi047 ceph-mon[29365]: osdmap e20: 3 total, 3 up, 3 in 2024-04-06T03:31:35.214 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:35 smithi047 ceph-mon[29365]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:35.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:35 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:35.215 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:35 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-06T03:31:35.215 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:35 smithi047 ceph-mon[37680]: osdmap e20: 3 total, 3 up, 3 in 2024-04-06T03:31:35.215 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:35 smithi047 ceph-mon[37680]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:35.215 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:35 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:35.215 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57415]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-06T03:31:35.215 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57415]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:35.215 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57415]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:35.215 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:34 smithi047 sudo[57415]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:35 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-06T03:31:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:35 smithi102 ceph-mon[32821]: osdmap e20: 3 total, 3 up, 3 in 2024-04-06T03:31:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:35 smithi102 ceph-mon[32821]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:35 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:35.490 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57430]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-06T03:31:35.491 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57430]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:35.491 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57430]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:35.491 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57430]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:35.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57441]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-06T03:31:35.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57441]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:35.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57441]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:35.743 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57441]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:36.014 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57444]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-06T03:31:36.014 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57444]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:36.014 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57444]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:36.014 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:31:35 smithi047 sudo[57444]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:36.281 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 sudo[57467]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-06T03:31:36.282 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 sudo[57467]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:36.282 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 sudo[57467]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:36.282 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 sudo[57467]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:36.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 -- 172.21.15.47:0/2942974517 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4102330 msgr2=0x7f30e4102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:36.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 --2- 172.21.15.47:0/2942974517 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4102330 0x7f30e4102750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0098f0 tx=0x7f30dc009c00 comp rx=0 tx=0).stop 2024-04-06T03:31:36.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 -- 172.21.15.47:0/2942974517 shutdown_connections 2024-04-06T03:31:36.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 --2- 172.21.15.47:0/2942974517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4103ed0 0x7f30e410a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:36.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 --2- 172.21.15.47:0/2942974517 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4102330 0x7f30e4102750 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:36.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 --2- 172.21.15.47:0/2942974517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30e4103530 0x7f30e4103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 -- 172.21.15.47:0/2942974517 >> 172.21.15.47:0/2942974517 conn(0x7f30e40fd8b0 msgr2=0x7f30e40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 -- 172.21.15.47:0/2942974517 shutdown_connections 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 -- 172.21.15.47:0/2942974517 wait complete. 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.362+0000 7f30eb84c700 1 Processor -- start 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30eb84c700 1 -- start start 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30eb84c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4102330 0x7f30e4076020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30eb84c700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4103530 0x7f30e40746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30eb84c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30e4103ed0 0x7f30e4074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30eb84c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f30e410d650 con 0x7f30e4103ed0 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30eb84c700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f30e410d4d0 con 0x7f30e4102330 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30eb84c700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f30e410d7d0 con 0x7f30e4103530 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e8de7700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4103530 0x7f30e40746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:31:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30e4103ed0 0x7f30e4074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30e4103ed0 0x7f30e4074c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56702/0 (socket says 172.21.15.47:56702) 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e8de7700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4103530 0x7f30e40746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:44374/0 (socket says 172.21.15.47:44374) 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 -- 172.21.15.47:0/4294751740 learned_addr learned my addr 172.21.15.47:0/4294751740 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e95e8700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4102330 0x7f30e4076020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 -- 172.21.15.47:0/4294751740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4103530 msgr2=0x7f30e40746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4103530 0x7f30e40746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 -- 172.21.15.47:0/4294751740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4102330 msgr2=0x7f30e4076020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4102330 0x7f30e4076020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 -- 172.21.15.47:0/4294751740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e40754d0 con 0x7f30e4103ed0 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e8de7700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4103530 0x7f30e40746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.363+0000 7f30e9de9700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30e4103ed0 0x7f30e4074c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30d4007ee0 tx=0x7f30d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.364+0000 7f30e27fc700 1 -- 172.21.15.47:0/4294751740 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d4004bb0 con 0x7f30e4103ed0 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.364+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e41a1df0 con 0x7f30e4103ed0 2024-04-06T03:31:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.364+0000 7f30e27fc700 1 -- 172.21.15.47:0/4294751740 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f30d4004d50 con 0x7f30e4103ed0 2024-04-06T03:31:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.364+0000 7f30e27fc700 1 -- 172.21.15.47:0/4294751740 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d4005940 con 0x7f30e4103ed0 2024-04-06T03:31:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.364+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e41a2240 con 0x7f30e4103ed0 2024-04-06T03:31:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.365+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e4068f90 con 0x7f30e4103ed0 2024-04-06T03:31:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.365+0000 7f30e27fc700 1 -- 172.21.15.47:0/4294751740 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f30d401a020 con 0x7f30e4103ed0 2024-04-06T03:31:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.365+0000 7f30e27fc700 1 --2- 172.21.15.47:0/4294751740 >> v2:172.21.15.47:6800/850698093 conn(0x7f30cc06db10 0x7f30cc06ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:31:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.366+0000 7f30e95e8700 1 --2- 172.21.15.47:0/4294751740 >> v2:172.21.15.47:6800/850698093 conn(0x7f30cc06db10 0x7f30cc06ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:31:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.366+0000 7f30e27fc700 1 -- 172.21.15.47:0/4294751740 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2511+0+0 (secure 0 0 0) 0x7f30d408c160 con 0x7f30e4103ed0 2024-04-06T03:31:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.366+0000 7f30e95e8700 1 --2- 172.21.15.47:0/4294751740 >> v2:172.21.15.47:6800/850698093 conn(0x7f30cc06db10 0x7f30cc06ffd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009fd0 tx=0x7f30dc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:31:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.370+0000 7f30e27fc700 1 -- 172.21.15.47:0/4294751740 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f30d4010070 con 0x7f30e4103ed0 2024-04-06T03:31:36.547 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 ceph-mon[32821]: osdmap e21: 3 total, 3 up, 3 in 2024-04-06T03:31:36.547 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 ceph-mon[32821]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:36.547 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 sudo[35379]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-06T03:31:36.547 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 sudo[35379]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:36.547 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 sudo[35379]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:36.547 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 sudo[35379]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:36.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:36.584+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f30e4062710 con 0x7f30cc06db10 2024-04-06T03:31:36.586 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:36 smithi047 ceph-mon[37680]: osdmap e21: 3 total, 3 up, 3 in 2024-04-06T03:31:36.586 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:36 smithi047 ceph-mon[37680]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:36.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 sudo[57477]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-06T03:31:36.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 sudo[57477]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:36.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 sudo[57477]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:36.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 sudo[57477]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:36.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 ceph-mon[29365]: osdmap e21: 3 total, 3 up, 3 in 2024-04-06T03:31:36.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:36 smithi047 ceph-mon[29365]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:36.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 sudo[35382]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-06T03:31:36.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 sudo[35382]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:36.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 sudo[35382]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:36.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:36 smithi102 sudo[35382]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:37.334 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 sudo[57593]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-06T03:31:37.334 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 sudo[57593]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:37.334 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 sudo[57593]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:37.334 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 sudo[57593]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 sudo[57629]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-06T03:31:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 sudo[57629]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-06T03:31:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 sudo[57629]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-06T03:31:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 sudo[57629]: pam_unix(sudo:session): session closed for user root 2024-04-06T03:31:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: mgrmap e15: y(active, since 2m), standbys: x 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: mgrmap e15: y(active, since 2m), standbys: x 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:31:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:37.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:37.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:37.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:37 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:37.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:37.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: mgrmap e15: y(active, since 2m), standbys: x 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:31:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:31:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:37 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:31:38.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:38 smithi047 ceph-mon[29365]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:31:38.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:38 smithi047 ceph-mon[29365]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:38.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:38 smithi047 ceph-mon[29365]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:38.444 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:38 smithi047 ceph-mon[37680]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:31:38.444 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:38 smithi047 ceph-mon[37680]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:38.445 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:38 smithi047 ceph-mon[37680]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:38.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:38 smithi102 ceph-mon[32821]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:31:38.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:38 smithi102 ceph-mon[32821]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T03:31:38.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:38 smithi102 ceph-mon[32821]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T03:31:39.652 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[29365]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/195384510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]: dispatch 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]: dispatch 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]': finished 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[29365]: osdmap e22: 4 total, 3 up, 4 in 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[37680]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/195384510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]: dispatch 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]: dispatch 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]': finished 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[37680]: osdmap e22: 4 total, 3 up, 4 in 2024-04-06T03:31:39.653 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:39 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:39.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:39 smithi102 ceph-mon[32821]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:39.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/195384510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]: dispatch 2024-04-06T03:31:39.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]: dispatch 2024-04-06T03:31:39.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "148e8f94-0638-4af1-9a5e-f8ec0ee2cf79"}]': finished 2024-04-06T03:31:39.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:39 smithi102 ceph-mon[32821]: osdmap e22: 4 total, 3 up, 4 in 2024-04-06T03:31:39.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:39 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:40.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/26469894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:31:40.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/26469894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:31:40.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/26469894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:31:41.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:41 smithi047 ceph-mon[29365]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:41.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:41 smithi047 ceph-mon[37680]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:41.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:41 smithi102 ceph-mon[32821]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:42.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:42 smithi102 ceph-mon[32821]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-06T03:31:42.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:42 smithi047 ceph-mon[29365]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-06T03:31:42.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:42 smithi047 ceph-mon[37680]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-06T03:31:44.791 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:44 smithi047 ceph-mon[29365]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-06T03:31:44.791 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:44 smithi047 ceph-mon[37680]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-06T03:31:44.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:44 smithi102 ceph-mon[32821]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-06T03:31:46.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T03:31:46.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T03:31:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T03:31:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:46 smithi047 ceph-mon[29365]: Deploying daemon osd.3 on smithi047 2024-04-06T03:31:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:46 smithi047 ceph-mon[29365]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-06T03:31:47.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:46 smithi047 ceph-mon[37680]: Deploying daemon osd.3 on smithi047 2024-04-06T03:31:47.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:46 smithi047 ceph-mon[37680]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-06T03:31:47.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:46 smithi102 ceph-mon[32821]: Deploying daemon osd.3 on smithi047 2024-04-06T03:31:47.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:46 smithi102 ceph-mon[32821]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-06T03:31:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:48 smithi047 ceph-mon[29365]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-06T03:31:48.738 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:48 smithi047 ceph-mon[37680]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-06T03:31:48.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:48 smithi102 ceph-mon[32821]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-06T03:31:50.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:50 smithi047 ceph-mon[29365]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 70 KiB/s wr, 5 op/s 2024-04-06T03:31:50.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:50 smithi047 ceph-mon[37680]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 70 KiB/s wr, 5 op/s 2024-04-06T03:31:50.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:50 smithi102 ceph-mon[32821]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 70 KiB/s wr, 5 op/s 2024-04-06T03:31:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:52 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:52 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:52 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:52 smithi047 ceph-mon[29365]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-06T03:31:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:52 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:52 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:52 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:52 smithi047 ceph-mon[37680]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-06T03:31:53.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:52 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:53.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:52 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:53.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:52 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:53.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:52 smithi102 ceph-mon[32821]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-06T03:31:54.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:54 smithi047 ceph-mon[29365]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:54.706 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:54 smithi047 ceph-mon[37680]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:54.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:54 smithi102 ceph-mon[32821]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:55.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.348+0000 7f30e27fc700 1 -- 172.21.15.47:0/4294751740 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f30e4062710 con 0x7f30cc06db10 2024-04-06T03:31:55.350 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 3 on host 'smithi047' 2024-04-06T03:31:55.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 >> v2:172.21.15.47:6800/850698093 conn(0x7f30cc06db10 msgr2=0x7f30cc06ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:55.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 --2- 172.21.15.47:0/4294751740 >> v2:172.21.15.47:6800/850698093 conn(0x7f30cc06db10 0x7f30cc06ffd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009fd0 tx=0x7f30dc019040 comp rx=0 tx=0).stop 2024-04-06T03:31:55.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30e4103ed0 msgr2=0x7f30e4074c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:31:55.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30e4103ed0 0x7f30e4074c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30d4007ee0 tx=0x7f30d400d3b0 comp rx=0 tx=0).stop 2024-04-06T03:31:55.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 shutdown_connections 2024-04-06T03:31:55.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 --2- 172.21.15.47:0/4294751740 >> v2:172.21.15.47:6800/850698093 conn(0x7f30cc06db10 0x7f30cc06ffd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:55.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30e4103ed0 0x7f30e4074c00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:55.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4102330 0x7f30e4076020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:55.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 --2- 172.21.15.47:0/4294751740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30e4103530 0x7f30e40746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:31:55.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 >> 172.21.15.47:0/4294751740 conn(0x7f30e40fd8b0 msgr2=0x7f30e4106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:31:55.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 shutdown_connections 2024-04-06T03:31:55.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:31:55.351+0000 7f30eb84c700 1 -- 172.21.15.47:0/4294751740 wait complete. 2024-04-06T03:31:55.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T03:31:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:55 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.939 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:55.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:55 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:31:56.095 DEBUG:teuthology.orchestra.run.smithi047:osd.3> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.3.service 2024-04-06T03:31:56.097 INFO:tasks.cephadm:Deploying osd.4 on smithi102 with /dev/vg_nvme/lv_4... 2024-04-06T03:31:56.097 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-06T03:31:56.338 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:31:56.556 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[37680]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-06T03:31:56.556 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[37680]: osdmap e23: 4 total, 3 up, 4 in 2024-04-06T03:31:56.556 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:56.556 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[37680]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:56.724 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:56 smithi102 ceph-mon[32821]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-06T03:31:56.724 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:56 smithi102 ceph-mon[32821]: osdmap e23: 4 total, 3 up, 4 in 2024-04-06T03:31:56.724 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:56 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:56.724 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:56 smithi102 ceph-mon[32821]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:56.724 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:56 smithi102 ceph-mon[32821]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:56.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[37680]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[29365]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-06T03:31:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[29365]: osdmap e23: 4 total, 3 up, 4 in 2024-04-06T03:31:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[29365]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-06T03:31:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-mon[29365]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-06T03:31:56.993 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3[59401]: 2024-04-06T03:31:56.559+0000 7f2a0f933700 -1 osd.3 0 waiting for initial osdmap 2024-04-06T03:31:56.994 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 03:31:56 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3[59401]: 2024-04-06T03:31:56.563+0000 7f2a0b726700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T03:31:57.661 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:57 smithi102 ceph-mon[32821]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:57.661 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:57 smithi102 ceph-mon[32821]: osdmap e24: 4 total, 3 up, 4 in 2024-04-06T03:31:57.661 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:57 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:57.661 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:57 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:57.868 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:57 smithi047 ceph-mon[29365]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:57.868 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:57 smithi047 ceph-mon[29365]: osdmap e24: 4 total, 3 up, 4 in 2024-04-06T03:31:57.868 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:57 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:57.868 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:57 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:57.869 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:57 smithi047 ceph-mon[37680]: from='osd.3 v2:172.21.15.47:6813/299519913' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-06T03:31:57.869 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:57 smithi047 ceph-mon[37680]: osdmap e24: 4 total, 3 up, 4 in 2024-04-06T03:31:57.869 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:57 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:57.869 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:57 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:58.229 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-06T03:31:58.229 INFO:teuthology.orchestra.run.smithi102.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-06T03:31:58.229 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10+0 records in 2024-04-06T03:31:58.229 INFO:teuthology.orchestra.run.smithi102.stderr:10+0 records out 2024-04-06T03:31:58.229 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113707 s, 922 MB/s 2024-04-06T03:31:58.229 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping successful for: 2024-04-06T03:31:58.708 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[29365]: purged_snaps scrub starts 2024-04-06T03:31:58.708 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[29365]: purged_snaps scrub ok 2024-04-06T03:31:58.708 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[29365]: osd.3 v2:172.21.15.47:6813/299519913 boot 2024-04-06T03:31:58.708 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[29365]: osdmap e25: 4 total, 4 up, 4 in 2024-04-06T03:31:58.708 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:58.709 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[29365]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:31:58.709 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[37680]: purged_snaps scrub starts 2024-04-06T03:31:58.709 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[37680]: purged_snaps scrub ok 2024-04-06T03:31:58.709 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[37680]: osd.3 v2:172.21.15.47:6813/299519913 boot 2024-04-06T03:31:58.709 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[37680]: osdmap e25: 4 total, 4 up, 4 in 2024-04-06T03:31:58.709 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:58.709 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:58 smithi047 ceph-mon[37680]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:31:58.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:58 smithi102 ceph-mon[32821]: purged_snaps scrub starts 2024-04-06T03:31:58.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:58 smithi102 ceph-mon[32821]: purged_snaps scrub ok 2024-04-06T03:31:58.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:58 smithi102 ceph-mon[32821]: osd.3 v2:172.21.15.47:6813/299519913 boot 2024-04-06T03:31:58.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:58 smithi102 ceph-mon[32821]: osdmap e25: 4 total, 4 up, 4 in 2024-04-06T03:31:58.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:58 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:31:58.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:58 smithi102 ceph-mon[32821]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:31:58.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi102:vg_nvme/lv_4 2024-04-06T03:31:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:31:59.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: osdmap e26: 4 total, 4 up, 4 in 2024-04-06T03:31:59.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: Detected new or changed devices on smithi047 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi047 to 4017M 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:31:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: osdmap e26: 4 total, 4 up, 4 in 2024-04-06T03:31:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: Detected new or changed devices on smithi047 2024-04-06T03:31:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi047 to 4017M 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: osdmap e26: 4 total, 4 up, 4 in 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: Detected new or changed devices on smithi047 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:31:59.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi047 to 4017M 2024-04-06T03:31:59.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:31:59.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:31:59.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:31:59.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:31:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 -- 172.21.15.102:0/2435509400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103500 msgr2=0x7f81d4103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 --2- 172.21.15.102:0/2435509400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103500 0x7f81d4103960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81c40099c0 tx=0x7f81c4009cd0 comp rx=0 tx=0).stop 2024-04-06T03:32:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 -- 172.21.15.102:0/2435509400 shutdown_connections 2024-04-06T03:32:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 --2- 172.21.15.102:0/2435509400 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f81d4103ea0 0x7f81d410a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 --2- 172.21.15.102:0/2435509400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102300 0x7f81d4102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 --2- 172.21.15.102:0/2435509400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103500 0x7f81d4103960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 -- 172.21.15.102:0/2435509400 >> 172.21.15.102:0/2435509400 conn(0x7f81d40fd8e0 msgr2=0x7f81d40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 -- 172.21.15.102:0/2435509400 shutdown_connections 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 -- 172.21.15.102:0/2435509400 wait complete. 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.701+0000 7f81dbb76700 1 Processor -- start 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 -- start start 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f81d4102300 0x7f81d4197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4103500 0x7f81d4198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103ea0 0x7f81d419f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81d410d630 con 0x7f81d4103500 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81d410d4b0 con 0x7f81d4103ea0 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f81d410d7b0 con 0x7f81d4102300 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103ea0 0x7f81d419f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103ea0 0x7f81d419f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43894/0 (socket says 172.21.15.102:43894) 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 -- 172.21.15.102:0/3354266872 learned_addr learned my addr 172.21.15.102:0/3354266872 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:32:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81d9111700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4103500 0x7f81d4198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81d9912700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f81d4102300 0x7f81d4197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 -- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f81d4102300 msgr2=0x7f81d4197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f81d4102300 0x7f81d4197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 -- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4103500 msgr2=0x7f81d4198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4103500 0x7f81d4198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 -- 172.21.15.102:0/3354266872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d419f880 con 0x7f81d4103ea0 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81d9912700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f81d4102300 0x7f81d4197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81da113700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103ea0 0x7f81d419f1b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f81cc007ee0 tx=0x7f81cc00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81caffd700 1 -- 172.21.15.102:0/3354266872 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc00dbd0 con 0x7f81d4103ea0 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81caffd700 1 -- 172.21.15.102:0/3354266872 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f81cc00dd70 con 0x7f81d4103ea0 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d419fb70 con 0x7f81d4103ea0 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81caffd700 1 -- 172.21.15.102:0/3354266872 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0058e0 con 0x7f81d4103ea0 2024-04-06T03:32:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.702+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d41a00b0 con 0x7f81d4103ea0 2024-04-06T03:32:00.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.703+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d4068f90 con 0x7f81d4103ea0 2024-04-06T03:32:00.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.704+0000 7f81caffd700 1 -- 172.21.15.102:0/3354266872 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f81cc01a020 con 0x7f81d4103ea0 2024-04-06T03:32:00.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.704+0000 7f81caffd700 1 --2- 172.21.15.102:0/3354266872 >> v2:172.21.15.47:6800/850698093 conn(0x7f81c006db10 0x7f81c006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:00.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.704+0000 7f81caffd700 1 -- 172.21.15.102:0/3354266872 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 2803+0+0 (secure 0 0 0) 0x7f81cc08c300 con 0x7f81d4103ea0 2024-04-06T03:32:00.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.704+0000 7f81d9912700 1 --2- 172.21.15.102:0/3354266872 >> v2:172.21.15.47:6800/850698093 conn(0x7f81c006db10 0x7f81c006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:00.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.705+0000 7f81d9912700 1 --2- 172.21.15.102:0/3354266872 >> v2:172.21.15.47:6800/850698093 conn(0x7f81c006db10 0x7f81c006ffd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f81d4199110 tx=0x7f81d000b690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:32:00.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.709+0000 7f81caffd700 1 -- 172.21.15.102:0/3354266872 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f81cc010070 con 0x7f81d4103ea0 2024-04-06T03:32:00.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:00 smithi102 ceph-mon[32821]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:00.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:00.913+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f81d402dec0 con 0x7f81c006db10 2024-04-06T03:32:00.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:00 smithi047 ceph-mon[29365]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:00.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:00 smithi047 ceph-mon[37680]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:01.796 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:01 smithi102 ceph-mon[32821]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:01.796 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:01 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:01.796 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:01 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:01.796 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:01 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:01.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:01 smithi047 ceph-mon[29365]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:01.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:01 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:01.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:01 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:01.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:01 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:01.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:01 smithi047 ceph-mon[37680]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:01.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:01 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:01.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:01 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:01.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:01 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:02.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:02 smithi102 ceph-mon[32821]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:02.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:02 smithi047 ceph-mon[29365]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:02.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:02 smithi047 ceph-mon[37680]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:03.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/1295964410' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]: dispatch 2024-04-06T03:32:03.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]: dispatch 2024-04-06T03:32:03.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]': finished 2024-04-06T03:32:03.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:03 smithi102 ceph-mon[32821]: osdmap e27: 5 total, 4 up, 5 in 2024-04-06T03:32:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:03 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:03.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/1295964410' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]: dispatch 2024-04-06T03:32:03.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]: dispatch 2024-04-06T03:32:03.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]': finished 2024-04-06T03:32:03.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[29365]: osdmap e27: 5 total, 4 up, 5 in 2024-04-06T03:32:03.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/1295964410' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]: dispatch 2024-04-06T03:32:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]: dispatch 2024-04-06T03:32:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccfd48fd-61bd-46b4-b83a-c8396e41b3a5"}]': finished 2024-04-06T03:32:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[37680]: osdmap e27: 5 total, 4 up, 5 in 2024-04-06T03:32:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:03 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/2100945736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:04 smithi047 ceph-mon[37680]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/2100945736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:04 smithi047 ceph-mon[29365]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:05.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/2100945736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:05.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:04 smithi102 ceph-mon[32821]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:06.749 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:06 smithi102 ceph-mon[32821]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:06.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:06 smithi047 ceph-mon[37680]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:06.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:06 smithi047 ceph-mon[29365]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:08 smithi047 ceph-mon[29365]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:08 smithi047 ceph-mon[37680]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:08.824 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:08 smithi102 ceph-mon[32821]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:10.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:09 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T03:32:10.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:09 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:10.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:09 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T03:32:10.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:09 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:09 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T03:32:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:09 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:11.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:10 smithi102 ceph-mon[32821]: Deploying daemon osd.4 on smithi102 2024-04-06T03:32:11.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:10 smithi102 ceph-mon[32821]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:11.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:10 smithi047 ceph-mon[29365]: Deploying daemon osd.4 on smithi102 2024-04-06T03:32:11.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:10 smithi047 ceph-mon[29365]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:11.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:10 smithi047 ceph-mon[37680]: Deploying daemon osd.4 on smithi102 2024-04-06T03:32:11.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:10 smithi047 ceph-mon[37680]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:12.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:12 smithi102 ceph-mon[32821]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:12.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:12 smithi047 ceph-mon[29365]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:12 smithi047 ceph-mon[37680]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:14.784 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:14 smithi102 ceph-mon[32821]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:14.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:14 smithi047 ceph-mon[29365]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:14.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:14 smithi047 ceph-mon[37680]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:16.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:16 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:16.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:16 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:16.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:16 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:16.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:16 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:16.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:16 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:16.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:16 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:16.525 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:16 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:16.525 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:16 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:16.525 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:16 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:17.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:17 smithi102 ceph-mon[32821]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:17.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:17 smithi047 ceph-mon[29365]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:17.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:17 smithi047 ceph-mon[37680]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:18.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.727+0000 7f81caffd700 1 -- 172.21.15.102:0/3354266872 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f81d402dec0 con 0x7f81c006db10 2024-04-06T03:32:18.730 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 4 on host 'smithi102' 2024-04-06T03:32:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.729+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 >> v2:172.21.15.47:6800/850698093 conn(0x7f81c006db10 msgr2=0x7f81c006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.729+0000 7f81dbb76700 1 --2- 172.21.15.102:0/3354266872 >> v2:172.21.15.47:6800/850698093 conn(0x7f81c006db10 0x7f81c006ffd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f81d4199110 tx=0x7f81d000b690 comp rx=0 tx=0).stop 2024-04-06T03:32:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103ea0 msgr2=0x7f81d419f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103ea0 0x7f81d419f1b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f81cc007ee0 tx=0x7f81cc00d3b0 comp rx=0 tx=0).stop 2024-04-06T03:32:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 shutdown_connections 2024-04-06T03:32:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 --2- 172.21.15.102:0/3354266872 >> v2:172.21.15.47:6800/850698093 conn(0x7f81c006db10 0x7f81c006ffd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d4103ea0 0x7f81d419f1b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f81d4102300 0x7f81d4197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 --2- 172.21.15.102:0/3354266872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4103500 0x7f81d4198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 >> 172.21.15.102:0/3354266872 conn(0x7f81d40fd8e0 msgr2=0x7f81d4106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:32:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 shutdown_connections 2024-04-06T03:32:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:18.730+0000 7f81dbb76700 1 -- 172.21.15.102:0/3354266872 wait complete. 2024-04-06T03:32:19.039 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.041 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='osd.4 v2:172.21.15.102:6800/1031996030' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.042 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:18 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='osd.4 v2:172.21.15.102:6800/1031996030' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='osd.4 v2:172.21.15.102:6800/1031996030' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:18 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:19.365 DEBUG:teuthology.orchestra.run.smithi102:osd.4> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.4.service 2024-04-06T03:32:19.367 INFO:tasks.cephadm:Deploying osd.5 on smithi102 with /dev/vg_nvme/lv_3... 2024-04-06T03:32:19.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-06T03:32:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[29365]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-06T03:32:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[29365]: osdmap e28: 5 total, 4 up, 5 in 2024-04-06T03:32:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[29365]: from='osd.4 v2:172.21.15.102:6800/1031996030' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[29365]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[37680]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-06T03:32:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[37680]: osdmap e28: 5 total, 4 up, 5 in 2024-04-06T03:32:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[37680]: from='osd.4 v2:172.21.15.102:6800/1031996030' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:19 smithi047 ceph-mon[37680]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:20.290 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:19 smithi102 ceph-mon[32821]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-06T03:32:20.290 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:19 smithi102 ceph-mon[32821]: osdmap e28: 5 total, 4 up, 5 in 2024-04-06T03:32:20.290 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:20.290 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:19 smithi102 ceph-mon[32821]: from='osd.4 v2:172.21.15.102:6800/1031996030' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:20.290 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:19 smithi102 ceph-mon[32821]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:20.584 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 03:32:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T03:32:20.288+0000 7f25d7017700 -1 osd.4 0 waiting for initial osdmap 2024-04-06T03:32:20.584 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 03:32:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T03:32:20.291+0000 7f25cee02700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T03:32:20.882 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:20 smithi102 ceph-mon[32821]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:32:20.883 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:20 smithi102 ceph-mon[32821]: osdmap e29: 5 total, 4 up, 5 in 2024-04-06T03:32:20.883 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:20 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:20.883 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:20 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:20.883 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:20 smithi102 ceph-mon[32821]: from='osd.4 ' entity='osd.4' 2024-04-06T03:32:20.883 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:20 smithi102 ceph-mon[32821]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[29365]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[29365]: osdmap e29: 5 total, 4 up, 5 in 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[29365]: from='osd.4 ' entity='osd.4' 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[29365]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[37680]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[37680]: osdmap e29: 5 total, 4 up, 5 in 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:21.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[37680]: from='osd.4 ' entity='osd.4' 2024-04-06T03:32:21.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:20 smithi047 ceph-mon[37680]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-06T03:32:22.148 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:21 smithi102 ceph-mon[32821]: purged_snaps scrub starts 2024-04-06T03:32:22.148 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:21 smithi102 ceph-mon[32821]: purged_snaps scrub ok 2024-04-06T03:32:22.148 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:21 smithi102 ceph-mon[32821]: osd.4 v2:172.21.15.102:6800/1031996030 boot 2024-04-06T03:32:22.148 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:21 smithi102 ceph-mon[32821]: osdmap e30: 5 total, 5 up, 5 in 2024-04-06T03:32:22.149 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:21 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:22.149 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:21 smithi102 ceph-mon[32821]: osdmap e31: 5 total, 5 up, 5 in 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[29365]: purged_snaps scrub starts 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[29365]: purged_snaps scrub ok 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[29365]: osd.4 v2:172.21.15.102:6800/1031996030 boot 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[29365]: osdmap e30: 5 total, 5 up, 5 in 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[29365]: osdmap e31: 5 total, 5 up, 5 in 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[37680]: purged_snaps scrub starts 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[37680]: purged_snaps scrub ok 2024-04-06T03:32:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[37680]: osd.4 v2:172.21.15.102:6800/1031996030 boot 2024-04-06T03:32:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[37680]: osdmap e30: 5 total, 5 up, 5 in 2024-04-06T03:32:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:32:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:21 smithi047 ceph-mon[37680]: osdmap e31: 5 total, 5 up, 5 in 2024-04-06T03:32:23.045 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-06T03:32:23.045 INFO:teuthology.orchestra.run.smithi102.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-06T03:32:23.045 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10+0 records in 2024-04-06T03:32:23.045 INFO:teuthology.orchestra.run.smithi102.stderr:10+0 records out 2024-04-06T03:32:23.045 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123955 s, 846 MB/s 2024-04-06T03:32:23.045 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping successful for: 2024-04-06T03:32:23.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:22 smithi102 ceph-mon[32821]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-04-06T03:32:23.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:22 smithi102 ceph-mon[32821]: osdmap e32: 5 total, 5 up, 5 in 2024-04-06T03:32:23.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:22 smithi047 ceph-mon[29365]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-04-06T03:32:23.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:22 smithi047 ceph-mon[29365]: osdmap e32: 5 total, 5 up, 5 in 2024-04-06T03:32:23.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:22 smithi047 ceph-mon[37680]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-04-06T03:32:23.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:22 smithi047 ceph-mon[37680]: osdmap e32: 5 total, 5 up, 5 in 2024-04-06T03:32:23.709 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi102:vg_nvme/lv_3 2024-04-06T03:32:23.940 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:32:24.319 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: Detected new or changed devices on smithi102 2024-04-06T03:32:24.319 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.319 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.319 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:24.320 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi102 to 17088M 2024-04-06T03:32:24.320 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.320 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:24.320 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:24.320 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.320 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:24 smithi102 ceph-mon[32821]: osdmap e33: 5 total, 5 up, 5 in 2024-04-06T03:32:24.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: Detected new or changed devices on smithi102 2024-04-06T03:32:24.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:24.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi102 to 17088M 2024-04-06T03:32:24.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:24.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[29365]: osdmap e33: 5 total, 5 up, 5 in 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: Detected new or changed devices on smithi102 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi102 to 17088M 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:24.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:24 smithi047 ceph-mon[37680]: osdmap e33: 5 total, 5 up, 5 in 2024-04-06T03:32:25.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.460+0000 7f85dfdb3700 1 -- 172.21.15.102:0/114548735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 msgr2=0x7f85d8102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:25.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.460+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/114548735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 0x7f85d8102860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85d40099c0 tx=0x7f85d4009cd0 comp rx=0 tx=0).stop 2024-04-06T03:32:25.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.460+0000 7f85dfdb3700 1 -- 172.21.15.102:0/114548735 shutdown_connections 2024-04-06T03:32:25.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.460+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/114548735 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85d8102da0 0x7f85d8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:25.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.460+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/114548735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d8101200 0x7f85d8101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:25.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.460+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/114548735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 0x7f85d8102860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:25.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.460+0000 7f85dfdb3700 1 -- 172.21.15.102:0/114548735 >> 172.21.15.102:0/114548735 conn(0x7f85d80fc7c0 msgr2=0x7f85d80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.461+0000 7f85dfdb3700 1 -- 172.21.15.102:0/114548735 shutdown_connections 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.461+0000 7f85dfdb3700 1 -- 172.21.15.102:0/114548735 wait complete. 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.461+0000 7f85dfdb3700 1 Processor -- start 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.461+0000 7f85dfdb3700 1 -- start start 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.461+0000 7f85dfdb3700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85d8101200 0x7f85d806b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dfdb3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 0x7f85d819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dfdb3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d8102da0 0x7f85d819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dfdb3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85d810c570 con 0x7f85d8102da0 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dfdb3700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f85d810c3f0 con 0x7f85d8102400 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dfdb3700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f85d810c6f0 con 0x7f85d8101200 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 0x7f85d819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 0x7f85d819ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60944/0 (socket says 172.21.15.102:60944) 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 -- 172.21.15.102:0/2134253632 learned_addr learned my addr 172.21.15.102:0/2134253632 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:32:25.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85ddb4f700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85d8101200 0x7f85d806b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85de350700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d8102da0 0x7f85d819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 -- 172.21.15.102:0/2134253632 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85d8101200 msgr2=0x7f85d806b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85d8101200 0x7f85d806b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 -- 172.21.15.102:0/2134253632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d8102da0 msgr2=0x7f85d819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d8102da0 0x7f85d819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 -- 172.21.15.102:0/2134253632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d819f8d0 con 0x7f85d8102400 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dd34e700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 0x7f85d819ca70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f85d4006010 tx=0x7f85d40047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85ceffd700 1 -- 172.21.15.102:0/2134253632 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d4027070 con 0x7f85d8102400 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85ceffd700 1 -- 172.21.15.102:0/2134253632 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f85d40041c0 con 0x7f85d8102400 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85ceffd700 1 -- 172.21.15.102:0/2134253632 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d400f460 con 0x7f85d8102400 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d819fb60 con 0x7f85d8102400 2024-04-06T03:32:25.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.462+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d81a0090 con 0x7f85d8102400 2024-04-06T03:32:25.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.463+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d8068f90 con 0x7f85d8102400 2024-04-06T03:32:25.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.464+0000 7f85ceffd700 1 -- 172.21.15.102:0/2134253632 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f85d402a070 con 0x7f85d8102400 2024-04-06T03:32:25.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.464+0000 7f85ceffd700 1 --2- 172.21.15.102:0/2134253632 >> v2:172.21.15.47:6800/850698093 conn(0x7f85c406db10 0x7f85c406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:25.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.464+0000 7f85ceffd700 1 -- 172.21.15.102:0/2134253632 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 3205+0+0 (secure 0 0 0) 0x7f85d408e0d0 con 0x7f85d8102400 2024-04-06T03:32:25.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.464+0000 7f85ddb4f700 1 --2- 172.21.15.102:0/2134253632 >> v2:172.21.15.47:6800/850698093 conn(0x7f85c406db10 0x7f85c406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:25.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.465+0000 7f85ddb4f700 1 --2- 172.21.15.102:0/2134253632 >> v2:172.21.15.47:6800/850698093 conn(0x7f85c406db10 0x7f85c406ffd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85d8102260 tx=0x7f85c800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:32:25.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.469+0000 7f85ceffd700 1 -- 172.21.15.102:0/2134253632 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f85d4013070 con 0x7f85d8102400 2024-04-06T03:32:25.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:25 smithi102 ceph-mon[32821]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-04-06T03:32:25.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:25 smithi102 ceph-mon[32821]: osdmap e34: 5 total, 5 up, 5 in 2024-04-06T03:32:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:25.675+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f85d802dee0 con 0x7f85c406db10 2024-04-06T03:32:25.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:25 smithi047 ceph-mon[29365]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-04-06T03:32:25.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:25 smithi047 ceph-mon[29365]: osdmap e34: 5 total, 5 up, 5 in 2024-04-06T03:32:25.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:25 smithi047 ceph-mon[37680]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-04-06T03:32:25.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:25 smithi047 ceph-mon[37680]: osdmap e34: 5 total, 5 up, 5 in 2024-04-06T03:32:26.350 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:26 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:26.351 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:26 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:26.351 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:26 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:26.644 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:26.644 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:26.644 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:26 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:26.644 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:26 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:26.644 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:26 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:26.644 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:26 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:27.474 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:27 smithi102 ceph-mon[32821]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:27.475 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:27 smithi102 ceph-mon[32821]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-04-06T03:32:27.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:27 smithi047 ceph-mon[37680]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:27.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:27 smithi047 ceph-mon[37680]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-04-06T03:32:27.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:27 smithi047 ceph-mon[29365]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:27.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:27 smithi047 ceph-mon[29365]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-04-06T03:32:28.651 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/653123214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]: dispatch 2024-04-06T03:32:28.651 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]: dispatch 2024-04-06T03:32:28.651 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]': finished 2024-04-06T03:32:28.651 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:28 smithi102 ceph-mon[32821]: osdmap e35: 6 total, 5 up, 6 in 2024-04-06T03:32:28.651 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:28 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/653123214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]: dispatch 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]: dispatch 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]': finished 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[29365]: osdmap e35: 6 total, 5 up, 6 in 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/653123214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]: dispatch 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]: dispatch 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1411f970-4f9e-4e08-9222-905c8c91835e"}]': finished 2024-04-06T03:32:28.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[37680]: osdmap e35: 6 total, 5 up, 6 in 2024-04-06T03:32:28.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:28 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:29.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:29 smithi047 ceph-mon[29365]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-04-06T03:32:29.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/2851109545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:29.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:29 smithi047 ceph-mon[37680]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-04-06T03:32:29.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/2851109545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:29.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:29 smithi102 ceph-mon[32821]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-04-06T03:32:29.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/2851109545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:30.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:30 smithi102 ceph-mon[32821]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-06T03:32:30.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:30 smithi047 ceph-mon[29365]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-06T03:32:30.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:30 smithi047 ceph-mon[37680]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-06T03:32:32.764 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:32 smithi102 ceph-mon[32821]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:32:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:32 smithi047 ceph-mon[29365]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:32:32.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:32 smithi047 ceph-mon[37680]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:32:34.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:34 smithi102 ceph-mon[32821]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-06T03:32:34.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:34 smithi047 ceph-mon[29365]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-06T03:32:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:34 smithi047 ceph-mon[37680]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-06T03:32:35.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:35 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T03:32:35.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:35 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:35.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:35 smithi102 ceph-mon[32821]: Deploying daemon osd.5 on smithi102 2024-04-06T03:32:35.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:35 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T03:32:35.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:35 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:35.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:35 smithi047 ceph-mon[29365]: Deploying daemon osd.5 on smithi102 2024-04-06T03:32:35.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:35 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T03:32:35.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:35 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:35.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:35 smithi047 ceph-mon[37680]: Deploying daemon osd.5 on smithi102 2024-04-06T03:32:36.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:36 smithi102 ceph-mon[32821]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:36.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:36 smithi047 ceph-mon[29365]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:36.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:36 smithi047 ceph-mon[37680]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:38.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:38 smithi102 ceph-mon[32821]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:38.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:38 smithi047 ceph-mon[29365]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:38.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:38 smithi047 ceph-mon[37680]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:40 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:40.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:40 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:40.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:40 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:40.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:40 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:40.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:40 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:40.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:40 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:40 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:40 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:40 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:41.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:41 smithi102 ceph-mon[32821]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:41.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:41 smithi047 ceph-mon[29365]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:41.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:41 smithi047 ceph-mon[37680]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:42.822 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:42 smithi102 ceph-mon[32821]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:42.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.886+0000 7f85ceffd700 1 -- 172.21.15.102:0/2134253632 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f85d802dee0 con 0x7f85c406db10 2024-04-06T03:32:42.887 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 5 on host 'smithi102' 2024-04-06T03:32:42.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 >> v2:172.21.15.47:6800/850698093 conn(0x7f85c406db10 msgr2=0x7f85c406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:42.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/2134253632 >> v2:172.21.15.47:6800/850698093 conn(0x7f85c406db10 0x7f85c406ffd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85d8102260 tx=0x7f85c800a380 comp rx=0 tx=0).stop 2024-04-06T03:32:42.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 msgr2=0x7f85d819ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:42.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 0x7f85d819ca70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f85d4006010 tx=0x7f85d40047b0 comp rx=0 tx=0).stop 2024-04-06T03:32:42.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 shutdown_connections 2024-04-06T03:32:42.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/2134253632 >> v2:172.21.15.47:6800/850698093 conn(0x7f85c406db10 0x7f85c406ffd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:42.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85d8102da0 0x7f85d819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:42.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85d8101200 0x7f85d806b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:42.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 --2- 172.21.15.102:0/2134253632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85d8102400 0x7f85d819ca70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:42.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.888+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 >> 172.21.15.102:0/2134253632 conn(0x7f85d80fc7c0 msgr2=0x7f85d80fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:32:42.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.889+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 shutdown_connections 2024-04-06T03:32:42.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:42.889+0000 7f85dfdb3700 1 -- 172.21.15.102:0/2134253632 wait complete. 2024-04-06T03:32:42.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:42 smithi047 ceph-mon[29365]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:42.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:42 smithi047 ceph-mon[37680]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:43.477 DEBUG:teuthology.orchestra.run.smithi102:osd.5> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.5.service 2024-04-06T03:32:43.479 INFO:tasks.cephadm:Deploying osd.6 on smithi102 with /dev/vg_nvme/lv_2... 2024-04-06T03:32:43.480 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-06T03:32:43.893 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:32:44.168 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:43 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:44.168 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:43 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:44.168 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:43 smithi102 ceph-mon[32821]: from='osd.5 v2:172.21.15.102:6804/386919126' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T03:32:44.168 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:43 smithi102 ceph-mon[32821]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T03:32:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:43 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:43 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:43 smithi047 ceph-mon[29365]: from='osd.5 v2:172.21.15.102:6804/386919126' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T03:32:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:43 smithi047 ceph-mon[29365]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T03:32:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:43 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:43 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:43 smithi047 ceph-mon[37680]: from='osd.5 v2:172.21.15.102:6804/386919126' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T03:32:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:43 smithi047 ceph-mon[37680]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T03:32:45.199 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:44 smithi102 ceph-mon[32821]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-06T03:32:45.199 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:44 smithi102 ceph-mon[32821]: osdmap e36: 6 total, 5 up, 6 in 2024-04-06T03:32:45.199 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:44 smithi102 ceph-mon[32821]: from='osd.5 v2:172.21.15.102:6804/386919126' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:45.199 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:44 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:45.199 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:44 smithi102 ceph-mon[32821]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:45.199 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:44 smithi102 ceph-mon[32821]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:45.199 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:44 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:45.199 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:44 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[29365]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[29365]: osdmap e36: 6 total, 5 up, 6 in 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[29365]: from='osd.5 v2:172.21.15.102:6804/386919126' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[29365]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[29365]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[37680]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[37680]: osdmap e36: 6 total, 5 up, 6 in 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[37680]: from='osd.5 v2:172.21.15.102:6804/386919126' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:45.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[37680]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:32:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[37680]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-04-06T03:32:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:44 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:45.529 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 03:32:45 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T03:32:45.287+0000 7faa92d0c700 -1 osd.5 0 waiting for initial osdmap 2024-04-06T03:32:45.529 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 03:32:45 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T03:32:45.292+0000 7faa8aaf7700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T03:32:45.923 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-06T03:32:45.924 INFO:teuthology.orchestra.run.smithi102.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-06T03:32:45.924 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10+0 records in 2024-04-06T03:32:45.924 INFO:teuthology.orchestra.run.smithi102.stderr:10+0 records out 2024-04-06T03:32:45.924 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122089 s, 859 MB/s 2024-04-06T03:32:45.924 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping successful for: 2024-04-06T03:32:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:45 smithi102 ceph-mon[32821]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:32:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:45 smithi102 ceph-mon[32821]: osdmap e37: 6 total, 5 up, 6 in 2024-04-06T03:32:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:45 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:45 smithi102 ceph-mon[32821]: from='osd.5 ' entity='osd.5' 2024-04-06T03:32:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[29365]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:32:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[29365]: osdmap e37: 6 total, 5 up, 6 in 2024-04-06T03:32:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[29365]: from='osd.5 ' entity='osd.5' 2024-04-06T03:32:46.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[37680]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:32:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[37680]: osdmap e37: 6 total, 5 up, 6 in 2024-04-06T03:32:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:45 smithi047 ceph-mon[37680]: from='osd.5 ' entity='osd.5' 2024-04-06T03:32:46.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi102:vg_nvme/lv_2 2024-04-06T03:32:46.985 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:32:47.080 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:46 smithi102 ceph-mon[32821]: purged_snaps scrub starts 2024-04-06T03:32:47.080 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:46 smithi102 ceph-mon[32821]: purged_snaps scrub ok 2024-04-06T03:32:47.080 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:46 smithi102 ceph-mon[32821]: osd.5 v2:172.21.15.102:6804/386919126 boot 2024-04-06T03:32:47.080 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:46 smithi102 ceph-mon[32821]: osdmap e38: 6 total, 6 up, 6 in 2024-04-06T03:32:47.081 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:47.081 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:46 smithi102 ceph-mon[32821]: pgmap v134: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[29365]: purged_snaps scrub starts 2024-04-06T03:32:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[29365]: purged_snaps scrub ok 2024-04-06T03:32:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[29365]: osd.5 v2:172.21.15.102:6804/386919126 boot 2024-04-06T03:32:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[29365]: osdmap e38: 6 total, 6 up, 6 in 2024-04-06T03:32:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[29365]: pgmap v134: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:47.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[37680]: purged_snaps scrub starts 2024-04-06T03:32:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[37680]: purged_snaps scrub ok 2024-04-06T03:32:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[37680]: osd.5 v2:172.21.15.102:6804/386919126 boot 2024-04-06T03:32:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[37680]: osdmap e38: 6 total, 6 up, 6 in 2024-04-06T03:32:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:32:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:46 smithi047 ceph-mon[37680]: pgmap v134: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:47.970 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:47 smithi102 ceph-mon[32821]: osdmap e39: 6 total, 6 up, 6 in 2024-04-06T03:32:47.971 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:47 smithi102 ceph-mon[32821]: osdmap e40: 6 total, 6 up, 6 in 2024-04-06T03:32:48.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:47 smithi047 ceph-mon[37680]: osdmap e39: 6 total, 6 up, 6 in 2024-04-06T03:32:48.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:47 smithi047 ceph-mon[37680]: osdmap e40: 6 total, 6 up, 6 in 2024-04-06T03:32:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:47 smithi047 ceph-mon[29365]: osdmap e39: 6 total, 6 up, 6 in 2024-04-06T03:32:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:47 smithi047 ceph-mon[29365]: osdmap e40: 6 total, 6 up, 6 in 2024-04-06T03:32:49.135 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:48 smithi102 ceph-mon[32821]: pgmap v137: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:49.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:48 smithi047 ceph-mon[29365]: pgmap v137: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:49.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:48 smithi047 ceph-mon[37680]: pgmap v137: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 -- 172.21.15.102:0/2002579814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 msgr2=0x7f525c10a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 --2- 172.21.15.102:0/2002579814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 0x7f525c10a750 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f525400b0d0 tx=0x7f525400b3e0 comp rx=0 tx=0).stop 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 -- 172.21.15.102:0/2002579814 shutdown_connections 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 --2- 172.21.15.102:0/2002579814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 0x7f525c10a750 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 --2- 172.21.15.102:0/2002579814 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f525c102300 0x7f525c102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 --2- 172.21.15.102:0/2002579814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f525c103500 0x7f525c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 -- 172.21.15.102:0/2002579814 >> 172.21.15.102:0/2002579814 conn(0x7f525c0fd8e0 msgr2=0x7f525c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 -- 172.21.15.102:0/2002579814 shutdown_connections 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.688+0000 7f526479f700 1 -- 172.21.15.102:0/2002579814 wait complete. 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526479f700 1 Processor -- start 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526479f700 1 -- start start 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526479f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f525c102300 0x7f525c197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526479f700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f525c103500 0x7f525c198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526479f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 0x7f525c19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526479f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f525c10d690 con 0x7f525c102300 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526479f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f525c10d510 con 0x7f525c103ea0 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526479f700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f525c10d810 con 0x7f525c103500 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 0x7f525c19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 0x7f525c19f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58232/0 (socket says 172.21.15.102:58232) 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 -- 172.21.15.102:0/2672886751 learned_addr learned my addr 172.21.15.102:0/2672886751 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f526253b700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f525c102300 0x7f525c197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5261d3a700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f525c103500 0x7f525c198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 -- 172.21.15.102:0/2672886751 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f525c103500 msgr2=0x7f525c198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f525c103500 0x7f525c198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 -- 172.21.15.102:0/2672886751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f525c102300 msgr2=0x7f525c197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f525c102300 0x7f525c197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 -- 172.21.15.102:0/2672886751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c19f930 con 0x7f525c103ea0 2024-04-06T03:32:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.689+0000 7f5262d3c700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 0x7f525c19f260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5254006070 tx=0x7f5254007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.690+0000 7f52537fe700 1 -- 172.21.15.102:0/2672886751 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525401f070 con 0x7f525c103ea0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.690+0000 7f52537fe700 1 -- 172.21.15.102:0/2672886751 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f5254005520 con 0x7f525c103ea0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.690+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c19fbc0 con 0x7f525c103ea0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.690+0000 7f52537fe700 1 -- 172.21.15.102:0/2672886751 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525401b910 con 0x7f525c103ea0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.690+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c1a0070 con 0x7f525c103ea0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.691+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c068f90 con 0x7f525c103ea0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.691+0000 7f52537fe700 1 -- 172.21.15.102:0/2672886751 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f5254022070 con 0x7f525c103ea0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.692+0000 7f52537fe700 1 --2- 172.21.15.102:0/2672886751 >> v2:172.21.15.47:6800/850698093 conn(0x7f524806db10 0x7f524806ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.692+0000 7f52537fe700 1 -- 172.21.15.102:0/2672886751 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 3497+0+0 (secure 0 0 0) 0x7f525400f020 con 0x7f525c103ea0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.692+0000 7f526253b700 1 --2- 172.21.15.102:0/2672886751 >> v2:172.21.15.47:6800/850698093 conn(0x7f524806db10 0x7f524806ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.692+0000 7f526253b700 1 --2- 172.21.15.102:0/2672886751 >> v2:172.21.15.47:6800/850698093 conn(0x7f524806db10 0x7f524806ffd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f525c100e10 tx=0x7f5258009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:32:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.696+0000 7f52537fe700 1 -- 172.21.15.102:0/2672886751 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5254029020 con 0x7f525c103ea0 2024-04-06T03:32:49.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:32:49.906+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f525c062710 con 0x7f524806db10 2024-04-06T03:32:50.157 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:49 smithi102 ceph-mon[32821]: osdmap e41: 6 total, 6 up, 6 in 2024-04-06T03:32:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:49 smithi047 ceph-mon[29365]: osdmap e41: 6 total, 6 up, 6 in 2024-04-06T03:32:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:49 smithi047 ceph-mon[37680]: osdmap e41: 6 total, 6 up, 6 in 2024-04-06T03:32:51.172 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: osdmap e42: 6 total, 6 up, 6 in 2024-04-06T03:32:51.172 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:51.172 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:51.172 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: Detected new or changed devices on smithi102 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi102 to 8544M 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.173 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:51.174 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.174 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:50 smithi102 ceph-mon[32821]: pgmap v140: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: osdmap e42: 6 total, 6 up, 6 in 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: Detected new or changed devices on smithi102 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi102 to 8544M 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[29365]: pgmap v140: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: osdmap e42: 6 total, 6 up, 6 in 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:32:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: Detected new or changed devices on smithi102 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi102 to 8544M 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:32:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:50 smithi047 ceph-mon[37680]: pgmap v140: 1 pgs: 1 unknown; 577 KiB data, 434 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:32:52.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:52 smithi102 ceph-mon[32821]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-06T03:32:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/3126711402' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]: dispatch 2024-04-06T03:32:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]: dispatch 2024-04-06T03:32:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]': finished 2024-04-06T03:32:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:52 smithi102 ceph-mon[32821]: osdmap e43: 7 total, 6 up, 7 in 2024-04-06T03:32:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:52 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:32:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[29365]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-06T03:32:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/3126711402' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]: dispatch 2024-04-06T03:32:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]: dispatch 2024-04-06T03:32:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]': finished 2024-04-06T03:32:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[29365]: osdmap e43: 7 total, 6 up, 7 in 2024-04-06T03:32:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:32:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[37680]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-06T03:32:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/3126711402' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]: dispatch 2024-04-06T03:32:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]: dispatch 2024-04-06T03:32:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1369f589-dc4c-4cd8-94c2-7e89b44fa548"}]': finished 2024-04-06T03:32:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[37680]: osdmap e43: 7 total, 6 up, 7 in 2024-04-06T03:32:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:52 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:32:53.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/906219799' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/906219799' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:53.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/906219799' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:32:54.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:54 smithi102 ceph-mon[32821]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-06T03:32:54.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:54 smithi047 ceph-mon[29365]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-06T03:32:54.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:54 smithi047 ceph-mon[37680]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-06T03:32:56.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:56 smithi047 ceph-mon[29365]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-04-06T03:32:56.795 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:56 smithi047 ceph-mon[37680]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-04-06T03:32:56.819 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:56 smithi102 ceph-mon[32821]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-04-06T03:32:58.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:58 smithi102 ceph-mon[32821]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-04-06T03:32:58.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:58 smithi047 ceph-mon[29365]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-04-06T03:32:58.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:58 smithi047 ceph-mon[37680]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-04-06T03:32:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-06T03:32:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:32:59 smithi102 ceph-mon[32821]: Deploying daemon osd.6 on smithi102 2024-04-06T03:32:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-06T03:32:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:32:59 smithi047 ceph-mon[37680]: Deploying daemon osd.6 on smithi102 2024-04-06T03:32:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-06T03:32:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:32:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:32:59 smithi047 ceph-mon[29365]: Deploying daemon osd.6 on smithi102 2024-04-06T03:33:00.825 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:00 smithi102 ceph-mon[32821]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-06T03:33:00.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:00 smithi047 ceph-mon[29365]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-06T03:33:00.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:00 smithi047 ceph-mon[37680]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-06T03:33:02.800 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:02 smithi102 ceph-mon[32821]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:02.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:02 smithi047 ceph-mon[29365]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:02.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:02 smithi047 ceph-mon[37680]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:04.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:04 smithi102 ceph-mon[32821]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:04.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:04 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:04.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:04 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:04 smithi047 ceph-mon[29365]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:04 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:04 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:04 smithi047 ceph-mon[37680]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:04 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:04 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:05.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:05 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:05.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:05 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:05.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:05 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:06.626 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:06 smithi102 ceph-mon[32821]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:06.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:06 smithi047 ceph-mon[29365]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:06.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:06 smithi047 ceph-mon[37680]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:08.370 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 6 on host 'smithi102' 2024-04-06T03:33:08.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.369+0000 7f52537fe700 1 -- 172.21.15.102:0/2672886751 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f525c062710 con 0x7f524806db10 2024-04-06T03:33:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 >> v2:172.21.15.47:6800/850698093 conn(0x7f524806db10 msgr2=0x7f524806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 --2- 172.21.15.102:0/2672886751 >> v2:172.21.15.47:6800/850698093 conn(0x7f524806db10 0x7f524806ffd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f525c100e10 tx=0x7f5258009190 comp rx=0 tx=0).stop 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 msgr2=0x7f525c19f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 0x7f525c19f260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5254006070 tx=0x7f5254007d90 comp rx=0 tx=0).stop 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 shutdown_connections 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 --2- 172.21.15.102:0/2672886751 >> v2:172.21.15.47:6800/850698093 conn(0x7f524806db10 0x7f524806ffd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525c103ea0 0x7f525c19f260 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f525c102300 0x7f525c197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 --2- 172.21.15.102:0/2672886751 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f525c103500 0x7f525c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 >> 172.21.15.102:0/2672886751 conn(0x7f525c0fd8e0 msgr2=0x7f525c0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 shutdown_connections 2024-04-06T03:33:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:08.371+0000 7f526479f700 1 -- 172.21.15.102:0/2672886751 wait complete. 2024-04-06T03:33:08.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:08 smithi102 ceph-mon[32821]: from='osd.6 v2:172.21.15.102:6808/4105297178' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-06T03:33:08.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:08 smithi102 ceph-mon[32821]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-06T03:33:08.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:08 smithi102 ceph-mon[32821]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[29365]: from='osd.6 v2:172.21.15.102:6808/4105297178' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-06T03:33:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[29365]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-06T03:33:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[29365]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:08.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[37680]: from='osd.6 v2:172.21.15.102:6808/4105297178' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-06T03:33:08.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[37680]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-06T03:33:08.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:08.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:08 smithi047 ceph-mon[37680]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:09.021 DEBUG:teuthology.orchestra.run.smithi102:osd.6> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.6.service 2024-04-06T03:33:09.023 INFO:tasks.cephadm:Deploying osd.7 on smithi102 with /dev/vg_nvme/lv_1... 2024-04-06T03:33:09.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-06T03:33:09.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:09 smithi102 ceph-mon[32821]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-06T03:33:09.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:09 smithi102 ceph-mon[32821]: from='osd.6 v2:172.21.15.102:6808/4105297178' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:09.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:09 smithi102 ceph-mon[32821]: osdmap e44: 7 total, 6 up, 7 in 2024-04-06T03:33:09.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:09 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:09.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:09 smithi102 ceph-mon[32821]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:09.672 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 03:33:09 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T03:33:09.526+0000 7f791b96b700 -1 osd.6 0 waiting for initial osdmap 2024-04-06T03:33:09.673 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 03:33:09 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T03:33:09.534+0000 7f791775e700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T03:33:09.913 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:33:09.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[29365]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-06T03:33:09.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[29365]: from='osd.6 v2:172.21.15.102:6808/4105297178' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:09.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[29365]: osdmap e44: 7 total, 6 up, 7 in 2024-04-06T03:33:09.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:09.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[29365]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:09.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[37680]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-06T03:33:09.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[37680]: from='osd.6 v2:172.21.15.102:6808/4105297178' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:09.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[37680]: osdmap e44: 7 total, 6 up, 7 in 2024-04-06T03:33:09.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:09.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:09 smithi047 ceph-mon[37680]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:10.534 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:10 smithi102 ceph-mon[32821]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:33:10.534 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:10 smithi102 ceph-mon[32821]: osdmap e45: 7 total, 6 up, 7 in 2024-04-06T03:33:10.534 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:10 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:10.534 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:10 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:10.534 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:10 smithi102 ceph-mon[32821]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:10.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[37680]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:33:10.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[37680]: osdmap e45: 7 total, 6 up, 7 in 2024-04-06T03:33:10.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:10.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:10.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[37680]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:10.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[29365]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:33:10.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[29365]: osdmap e45: 7 total, 6 up, 7 in 2024-04-06T03:33:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:10 smithi047 ceph-mon[29365]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-06T03:33:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:11 smithi102 ceph-mon[32821]: purged_snaps scrub starts 2024-04-06T03:33:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:11 smithi102 ceph-mon[32821]: purged_snaps scrub ok 2024-04-06T03:33:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:11 smithi102 ceph-mon[32821]: osd.6 v2:172.21.15.102:6808/4105297178 boot 2024-04-06T03:33:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:11 smithi102 ceph-mon[32821]: osdmap e46: 7 total, 7 up, 7 in 2024-04-06T03:33:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:11 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[29365]: purged_snaps scrub starts 2024-04-06T03:33:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[29365]: purged_snaps scrub ok 2024-04-06T03:33:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[29365]: osd.6 v2:172.21.15.102:6808/4105297178 boot 2024-04-06T03:33:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[29365]: osdmap e46: 7 total, 7 up, 7 in 2024-04-06T03:33:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:11.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[37680]: purged_snaps scrub starts 2024-04-06T03:33:11.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[37680]: purged_snaps scrub ok 2024-04-06T03:33:11.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[37680]: osd.6 v2:172.21.15.102:6808/4105297178 boot 2024-04-06T03:33:11.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[37680]: osdmap e46: 7 total, 7 up, 7 in 2024-04-06T03:33:11.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:11 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:33:12.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:12 smithi102 ceph-mon[32821]: osdmap e47: 7 total, 7 up, 7 in 2024-04-06T03:33:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:12 smithi102 ceph-mon[32821]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:12.900 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-06T03:33:12.900 INFO:teuthology.orchestra.run.smithi102.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-06T03:33:12.900 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10+0 records in 2024-04-06T03:33:12.900 INFO:teuthology.orchestra.run.smithi102.stderr:10+0 records out 2024-04-06T03:33:12.900 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0139801 s, 750 MB/s 2024-04-06T03:33:12.901 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping successful for: 2024-04-06T03:33:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:12 smithi047 ceph-mon[29365]: osdmap e47: 7 total, 7 up, 7 in 2024-04-06T03:33:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:12 smithi047 ceph-mon[29365]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:12 smithi047 ceph-mon[37680]: osdmap e47: 7 total, 7 up, 7 in 2024-04-06T03:33:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:12 smithi047 ceph-mon[37680]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:13.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi102:vg_nvme/lv_1 2024-04-06T03:33:13.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: osdmap e48: 7 total, 7 up, 7 in 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: Detected new or changed devices on smithi102 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi102 to 5696M 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:13.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:13 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.959 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:33:13.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: osdmap e48: 7 total, 7 up, 7 in 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: Detected new or changed devices on smithi102 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi102 to 5696M 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: osdmap e48: 7 total, 7 up, 7 in 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: Detected new or changed devices on smithi102 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi102 to 5696M 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:13.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:13 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:14.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:14 smithi102 ceph-mon[32821]: osdmap e49: 7 total, 7 up, 7 in 2024-04-06T03:33:14.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:14 smithi102 ceph-mon[32821]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:14.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:14 smithi047 ceph-mon[29365]: osdmap e49: 7 total, 7 up, 7 in 2024-04-06T03:33:14.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:14 smithi047 ceph-mon[29365]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:14.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:14 smithi047 ceph-mon[37680]: osdmap e49: 7 total, 7 up, 7 in 2024-04-06T03:33:14.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:14 smithi047 ceph-mon[37680]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 -- 172.21.15.102:0/623317238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 msgr2=0x7feb08102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 --2- 172.21.15.102:0/623317238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 0x7feb08102cd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb0000b0a0 tx=0x7feb0000b3b0 comp rx=0 tx=0).stop 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 -- 172.21.15.102:0/623317238 shutdown_connections 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 --2- 172.21.15.102:0/623317238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb08101e40 0x7feb081096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 --2- 172.21.15.102:0/623317238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 0x7feb08102cd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 --2- 172.21.15.102:0/623317238 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb08101480 0x7feb08101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 -- 172.21.15.102:0/623317238 >> 172.21.15.102:0/623317238 conn(0x7feb080fbf70 msgr2=0x7feb080fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 -- 172.21.15.102:0/623317238 shutdown_connections 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.558+0000 7feb0ec28700 1 -- 172.21.15.102:0/623317238 wait complete. 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0ec28700 1 Processor -- start 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0ec28700 1 -- start start 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0ec28700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb08101480 0x7feb08100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0ec28700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb08101e40 0x7feb0819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0ec28700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 0x7feb0819f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0ec28700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb0810c5a0 con 0x7feb08101e40 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0ec28700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb0810c420 con 0x7feb081028b0 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0ec28700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7feb0810c720 con 0x7feb08101480 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 0x7feb0819f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 0x7feb0819f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59666/0 (socket says 172.21.15.102:59666) 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0c9c4700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb08101480 0x7feb08100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 -- 172.21.15.102:0/1343979063 learned_addr learned my addr 172.21.15.102:0/1343979063 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb07fff700 1 --2- 172.21.15.102:0/1343979063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb08101e40 0x7feb0819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 -- 172.21.15.102:0/1343979063 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb08101480 msgr2=0x7feb08100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 --2- 172.21.15.102:0/1343979063 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb08101480 0x7feb08100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 -- 172.21.15.102:0/1343979063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb08101e40 msgr2=0x7feb0819cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 --2- 172.21.15.102:0/1343979063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb08101e40 0x7feb0819cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 -- 172.21.15.102:0/1343979063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0819f960 con 0x7feb081028b0 2024-04-06T03:33:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb0d1c5700 1 --2- 172.21.15.102:0/1343979063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 0x7feb0819f090 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b550 tx=0x7feaf000b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.559+0000 7feb05ffb700 1 -- 172.21.15.102:0/1343979063 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0015020 con 0x7feb081028b0 2024-04-06T03:33:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.560+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0819fc50 con 0x7feb081028b0 2024-04-06T03:33:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.560+0000 7feb05ffb700 1 -- 172.21.15.102:0/1343979063 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7feaf0011ce0 con 0x7feb081028b0 2024-04-06T03:33:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.560+0000 7feb05ffb700 1 -- 172.21.15.102:0/1343979063 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0010ca0 con 0x7feb081028b0 2024-04-06T03:33:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.560+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb081a0190 con 0x7feb081028b0 2024-04-06T03:33:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.561+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb08068f90 con 0x7feb081028b0 2024-04-06T03:33:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.561+0000 7feb05ffb700 1 -- 172.21.15.102:0/1343979063 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7feaf0018020 con 0x7feb081028b0 2024-04-06T03:33:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.562+0000 7feb05ffb700 1 --2- 172.21.15.102:0/1343979063 >> v2:172.21.15.47:6800/850698093 conn(0x7feaf406db10 0x7feaf406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.562+0000 7feb05ffb700 1 -- 172.21.15.102:0/1343979063 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3789+0+0 (secure 0 0 0) 0x7feaf008c730 con 0x7feb081028b0 2024-04-06T03:33:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.562+0000 7feb0c9c4700 1 --2- 172.21.15.102:0/1343979063 >> v2:172.21.15.47:6800/850698093 conn(0x7feaf406db10 0x7feaf406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.563+0000 7feb0c9c4700 1 --2- 172.21.15.102:0/1343979063 >> v2:172.21.15.47:6800/850698093 conn(0x7feaf406db10 0x7feaf406ffd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb00009fd0 tx=0x7feb0000b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.566+0000 7feb05ffb700 1 -- 172.21.15.102:0/1343979063 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7feaf001f020 con 0x7feb081028b0 2024-04-06T03:33:15.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:15 smithi102 ceph-mon[32821]: osdmap e50: 7 total, 7 up, 7 in 2024-04-06T03:33:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:15.767+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7feb0802dea0 con 0x7feaf406db10 2024-04-06T03:33:15.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:15 smithi047 ceph-mon[29365]: osdmap e50: 7 total, 7 up, 7 in 2024-04-06T03:33:15.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:15 smithi047 ceph-mon[37680]: osdmap e50: 7 total, 7 up, 7 in 2024-04-06T03:33:16.694 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:16 smithi102 ceph-mon[32821]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:16.694 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:16 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:33:16.694 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:16 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:33:16.694 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:16 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:16.694 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:16 smithi102 ceph-mon[32821]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-06T03:33:16.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[29365]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:16.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:33:16.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:33:16.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:16.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[29365]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-06T03:33:16.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[37680]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:16.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T03:33:16.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T03:33:16.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:16.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:16 smithi047 ceph-mon[37680]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-06T03:33:18.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:18 smithi102 ceph-mon[32821]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-06T03:33:18.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:18 smithi047 ceph-mon[29365]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-06T03:33:18.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:18 smithi047 ceph-mon[37680]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-06T03:33:19.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/3480337529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]: dispatch 2024-04-06T03:33:19.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]: dispatch 2024-04-06T03:33:19.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]': finished 2024-04-06T03:33:19.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:19 smithi102 ceph-mon[32821]: osdmap e51: 8 total, 7 up, 8 in 2024-04-06T03:33:19.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:19 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:19.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/3941570346' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:33:19.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/3480337529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]: dispatch 2024-04-06T03:33:19.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]: dispatch 2024-04-06T03:33:19.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]': finished 2024-04-06T03:33:19.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[29365]: osdmap e51: 8 total, 7 up, 8 in 2024-04-06T03:33:19.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:19.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/3941570346' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:33:19.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/3480337529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]: dispatch 2024-04-06T03:33:19.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]: dispatch 2024-04-06T03:33:19.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c782d6e2-04f7-462f-9f3e-ca539b5d8256"}]': finished 2024-04-06T03:33:19.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[37680]: osdmap e51: 8 total, 7 up, 8 in 2024-04-06T03:33:19.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:19.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/3941570346' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T03:33:20.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:20 smithi102 ceph-mon[32821]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-06T03:33:20.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:20 smithi047 ceph-mon[29365]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-06T03:33:20.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:20 smithi047 ceph-mon[37680]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-06T03:33:22.832 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:22 smithi102 ceph-mon[32821]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:33:22.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:22 smithi047 ceph-mon[29365]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:33:22.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:22 smithi047 ceph-mon[37680]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:33:24.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:24 smithi102 ceph-mon[32821]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-06T03:33:24.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:24 smithi047 ceph-mon[29365]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-06T03:33:24.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:24 smithi047 ceph-mon[37680]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-06T03:33:25.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:25 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-06T03:33:25.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:25 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:25.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:25 smithi102 ceph-mon[32821]: Deploying daemon osd.7 on smithi102 2024-04-06T03:33:25.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:25 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-06T03:33:25.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:25 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:25.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:25 smithi047 ceph-mon[29365]: Deploying daemon osd.7 on smithi102 2024-04-06T03:33:25.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:25 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-06T03:33:25.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:25 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:25.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:25 smithi047 ceph-mon[37680]: Deploying daemon osd.7 on smithi102 2024-04-06T03:33:26.726 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:26 smithi102 ceph-mon[32821]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:26.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:26 smithi047 ceph-mon[29365]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:26.894 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:26 smithi047 ceph-mon[37680]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:28.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:28 smithi102 ceph-mon[32821]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:28.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:28 smithi047 ceph-mon[29365]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:28.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:28 smithi047 ceph-mon[37680]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:30.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:30 smithi102 ceph-mon[32821]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:30.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:30 smithi047 ceph-mon[29365]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:30.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:30 smithi047 ceph-mon[37680]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:31.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:31 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:31.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:31 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:31.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:31 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:31 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:31 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:31 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:32.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:31 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:32.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:31 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:32.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:31 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:32.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:32 smithi102 ceph-mon[32821]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:32 smithi047 ceph-mon[29365]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:32.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:32 smithi047 ceph-mon[37680]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:34.056 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:33 smithi102 ceph-mon[32821]: from='osd.7 v2:172.21.15.102:6812/3557443636' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-06T03:33:34.056 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:33 smithi102 ceph-mon[32821]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-06T03:33:34.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.133+0000 7feb05ffb700 1 -- 172.21.15.102:0/1343979063 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feb0802dea0 con 0x7feaf406db10 2024-04-06T03:33:34.135 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 7 on host 'smithi102' 2024-04-06T03:33:34.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 >> v2:172.21.15.47:6800/850698093 conn(0x7feaf406db10 msgr2=0x7feaf406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:34.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 --2- 172.21.15.102:0/1343979063 >> v2:172.21.15.47:6800/850698093 conn(0x7feaf406db10 0x7feaf406ffd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb00009fd0 tx=0x7feb0000b7b0 comp rx=0 tx=0).stop 2024-04-06T03:33:34.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 msgr2=0x7feb0819f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:34.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 --2- 172.21.15.102:0/1343979063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 0x7feb0819f090 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b550 tx=0x7feaf000b860 comp rx=0 tx=0).stop 2024-04-06T03:33:34.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 shutdown_connections 2024-04-06T03:33:34.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 --2- 172.21.15.102:0/1343979063 >> v2:172.21.15.47:6800/850698093 conn(0x7feaf406db10 0x7feaf406ffd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:34.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 --2- 172.21.15.102:0/1343979063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb081028b0 0x7feb0819f090 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:34.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 --2- 172.21.15.102:0/1343979063 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb08101480 0x7feb08100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:34.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 --2- 172.21.15.102:0/1343979063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb08101e40 0x7feb0819cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:34.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 >> 172.21.15.102:0/1343979063 conn(0x7feb080fbf70 msgr2=0x7feb080fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:34.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 shutdown_connections 2024-04-06T03:33:34.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:34.136+0000 7feb0ec28700 1 -- 172.21.15.102:0/1343979063 wait complete. 2024-04-06T03:33:34.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:33 smithi047 ceph-mon[29365]: from='osd.7 v2:172.21.15.102:6812/3557443636' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-06T03:33:34.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:33 smithi047 ceph-mon[29365]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-06T03:33:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:33 smithi047 ceph-mon[37680]: from='osd.7 v2:172.21.15.102:6812/3557443636' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-06T03:33:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:33 smithi047 ceph-mon[37680]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-06T03:33:34.748 DEBUG:teuthology.orchestra.run.smithi102:osd.7> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.7.service 2024-04-06T03:33:34.750 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-04-06T03:33:34.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd stat -f json 2024-04-06T03:33:35.012 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:33:35.084 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T03:33:34.864+0000 7fe4ba0e3700 -1 osd.7 0 waiting for initial osdmap 2024-04-06T03:33:35.084 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T03:33:34.870+0000 7fe4b5ed6700 -1 osd.7 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T03:33:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-mon[32821]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-06T03:33:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-mon[32821]: osdmap e52: 8 total, 7 up, 8 in 2024-04-06T03:33:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-mon[32821]: from='osd.7 v2:172.21.15.102:6812/3557443636' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-mon[32821]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:34 smithi102 ceph-mon[32821]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:35.117 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[29365]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-06T03:33:35.117 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[29365]: osdmap e52: 8 total, 7 up, 8 in 2024-04-06T03:33:35.117 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[29365]: from='osd.7 v2:172.21.15.102:6812/3557443636' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[29365]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[29365]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[37680]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[37680]: osdmap e52: 8 total, 7 up, 8 in 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[37680]: from='osd.7 v2:172.21.15.102:6812/3557443636' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[37680]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:35.118 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:35.119 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:34 smithi047 ceph-mon[37680]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-04-06T03:33:36.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:35 smithi102 ceph-mon[32821]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:33:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:35 smithi102 ceph-mon[32821]: osdmap e53: 8 total, 7 up, 8 in 2024-04-06T03:33:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:35 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:35 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:35 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:35 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[37680]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:33:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[37680]: osdmap e53: 8 total, 7 up, 8 in 2024-04-06T03:33:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:36.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[29365]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-04-06T03:33:36.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[29365]: osdmap e53: 8 total, 7 up, 8 in 2024-04-06T03:33:36.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:36.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:36.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:36.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:35 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 -- 172.21.15.47:0/376094103 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 msgr2=0x7fe82c105220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 --2- 172.21.15.47:0/376094103 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 0x7fe82c105220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009f90 tx=0x7fe81c00b330 comp rx=0 tx=0).stop 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 -- 172.21.15.47:0/376094103 shutdown_connections 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 --2- 172.21.15.47:0/376094103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe82c108090 0x7fe82c10a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 --2- 172.21.15.47:0/376094103 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 0x7fe82c105220 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 --2- 172.21.15.47:0/376094103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c105760 0x7fe82c107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 -- 172.21.15.47:0/376094103 >> 172.21.15.47:0/376094103 conn(0x7fe82c0fc7a0 msgr2=0x7fe82c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 -- 172.21.15.47:0/376094103 shutdown_connections 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.809+0000 7fe833c1b700 1 -- 172.21.15.47:0/376094103 wait complete. 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe833c1b700 1 Processor -- start 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe833c1b700 1 -- start start 2024-04-06T03:33:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe833c1b700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 0x7fe82c197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe833c1b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c105760 0x7fe82c1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe833c1b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe82c108090 0x7fe82c19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe833c1b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c10d5c0 con 0x7fe82c105760 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe833c1b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c10d440 con 0x7fe82c108090 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe833c1b700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c10d740 con 0x7fe82c102e30 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c105760 0x7fe82c1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8319b7700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 0x7fe82c197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c105760 0x7fe82c1981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56160/0 (socket says 172.21.15.47:56160) 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8319b7700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 0x7fe82c197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:35696/0 (socket says 172.21.15.47:35696) 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 -- 172.21.15.47:0/252032316 learned_addr learned my addr 172.21.15.47:0/252032316 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8321b8700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe82c108090 0x7fe82c19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 -- 172.21.15.47:0/252032316 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 msgr2=0x7fe82c197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 0x7fe82c197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 -- 172.21.15.47:0/252032316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe82c108090 msgr2=0x7fe82c19f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe82c108090 0x7fe82c19f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 -- 172.21.15.47:0/252032316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c19f870 con 0x7fe82c105760 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8319b7700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 0x7fe82c197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.810+0000 7fe8311b6700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c105760 0x7fe82c1981b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe82000ec10 tx=0x7fe82000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.811+0000 7fe82affd700 1 -- 172.21.15.47:0/252032316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82000cc90 con 0x7fe82c105760 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.811+0000 7fe82affd700 1 -- 172.21.15.47:0/252032316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe82000ce30 con 0x7fe82c105760 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.811+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c19fb60 con 0x7fe82c105760 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.811+0000 7fe82affd700 1 -- 172.21.15.47:0/252032316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820010430 con 0x7fe82c105760 2024-04-06T03:33:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.811+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c1a00a0 con 0x7fe82c105760 2024-04-06T03:33:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.812+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c068f90 con 0x7fe82c105760 2024-04-06T03:33:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.812+0000 7fe82affd700 1 -- 172.21.15.47:0/252032316 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7fe820003fa0 con 0x7fe82c105760 2024-04-06T03:33:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.813+0000 7fe82affd700 1 --2- 172.21.15.47:0/252032316 >> v2:172.21.15.47:6800/850698093 conn(0x7fe81406db10 0x7fe81406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.813+0000 7fe82affd700 1 -- 172.21.15.47:0/252032316 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4114+0+0 (secure 0 0 0) 0x7fe82008d4b0 con 0x7fe82c105760 2024-04-06T03:33:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.813+0000 7fe8319b7700 1 --2- 172.21.15.47:0/252032316 >> v2:172.21.15.47:6800/850698093 conn(0x7fe81406db10 0x7fe81406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.813+0000 7fe8319b7700 1 --2- 172.21.15.47:0/252032316 >> v2:172.21.15.47:6800/850698093 conn(0x7fe81406db10 0x7fe81406ffd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009550 tx=0x7fe81c006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:36.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:36.817+0000 7fe82affd700 1 -- 172.21.15.47:0/252032316 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe82005b750 con 0x7fe82c105760 2024-04-06T03:33:37.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.024+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe82c02de30 con 0x7fe82c105760 2024-04-06T03:33:37.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.024+0000 7fe82affd700 1 -- 172.21.15.47:0/252032316 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v55) ==== 74+0+130 (secure 0 0 0) 0x7fe82005b050 con 0x7fe82c105760 2024-04-06T03:33:37.026 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 >> v2:172.21.15.47:6800/850698093 conn(0x7fe81406db10 msgr2=0x7fe81406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 --2- 172.21.15.47:0/252032316 >> v2:172.21.15.47:6800/850698093 conn(0x7fe81406db10 0x7fe81406ffd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009550 tx=0x7fe81c006000 comp rx=0 tx=0).stop 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c105760 msgr2=0x7fe82c1981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c105760 0x7fe82c1981b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe82000ec10 tx=0x7fe82000ef20 comp rx=0 tx=0).stop 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 shutdown_connections 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 --2- 172.21.15.47:0/252032316 >> v2:172.21.15.47:6800/850698093 conn(0x7fe81406db10 0x7fe81406ffd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe82c108090 0x7fe82c19f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe82c102e30 0x7fe82c197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 --2- 172.21.15.47:0/252032316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c105760 0x7fe82c1981b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 >> 172.21.15.47:0/252032316 conn(0x7fe82c0fc7a0 msgr2=0x7fe82c103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 shutdown_connections 2024-04-06T03:33:37.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:37.026+0000 7fe833c1b700 1 -- 172.21.15.47:0/252032316 wait complete. 2024-04-06T03:33:37.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:36 smithi102 ceph-mon[32821]: purged_snaps scrub starts 2024-04-06T03:33:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:36 smithi102 ceph-mon[32821]: purged_snaps scrub ok 2024-04-06T03:33:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:36 smithi102 ceph-mon[32821]: osd.7 v2:172.21.15.102:6812/3557443636 boot 2024-04-06T03:33:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:36 smithi102 ceph-mon[32821]: osdmap e54: 8 total, 8 up, 8 in 2024-04-06T03:33:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:36 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:36 smithi102 ceph-mon[32821]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[29365]: purged_snaps scrub starts 2024-04-06T03:33:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[29365]: purged_snaps scrub ok 2024-04-06T03:33:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[29365]: osd.7 v2:172.21.15.102:6812/3557443636 boot 2024-04-06T03:33:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[29365]: osdmap e54: 8 total, 8 up, 8 in 2024-04-06T03:33:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[29365]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:37.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[37680]: purged_snaps scrub starts 2024-04-06T03:33:37.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[37680]: purged_snaps scrub ok 2024-04-06T03:33:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[37680]: osd.7 v2:172.21.15.102:6812/3557443636 boot 2024-04-06T03:33:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[37680]: osdmap e54: 8 total, 8 up, 8 in 2024-04-06T03:33:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:33:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:36 smithi047 ceph-mon[37680]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:37.801 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1712374415,"num_in_osds":8,"osd_in_since":1712374398,"num_remapped_pgs":1} 2024-04-06T03:33:37.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-06T03:33:38.050 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:33:38.158 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:37 smithi102 ceph-mon[32821]: osdmap e55: 8 total, 8 up, 8 in 2024-04-06T03:33:38.158 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/252032316' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-06T03:33:38.167 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:37 smithi047 ceph-mon[29365]: osdmap e55: 8 total, 8 up, 8 in 2024-04-06T03:33:38.167 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/252032316' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-06T03:33:38.168 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:37 smithi047 ceph-mon[37680]: osdmap e55: 8 total, 8 up, 8 in 2024-04-06T03:33:38.168 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/252032316' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-06T03:33:39.184 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: osdmap e56: 8 total, 8 up, 8 in 2024-04-06T03:33:39.184 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: Detected new or changed devices on smithi102 2024-04-06T03:33:39.184 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.184 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.184 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.184 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.184 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.184 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi102 to 4272M 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[37680]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: osdmap e56: 8 total, 8 up, 8 in 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: Detected new or changed devices on smithi102 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.185 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi102 to 4272M 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:38 smithi047 ceph-mon[29365]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: osdmap e56: 8 total, 8 up, 8 in 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: Detected new or changed devices on smithi102 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:33:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi102 to 4272M 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:38 smithi102 ceph-mon[32821]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.821+0000 7f37c356a700 1 -- 172.21.15.47:0/1337718405 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f37bc106200 msgr2=0x7f37bc1065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.821+0000 7f37c356a700 1 --2- 172.21.15.47:0/1337718405 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f37bc106200 0x7f37bc1065e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f37b000bab0 tx=0x7f37b000bdc0 comp rx=0 tx=0).stop 2024-04-06T03:33:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.821+0000 7f37c356a700 1 -- 172.21.15.47:0/1337718405 shutdown_connections 2024-04-06T03:33:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.821+0000 7f37c356a700 1 --2- 172.21.15.47:0/1337718405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37bc102740 0x7f37bc10e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.821+0000 7f37c356a700 1 --2- 172.21.15.47:0/1337718405 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f37bc106200 0x7f37bc1065e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.821+0000 7f37c356a700 1 --2- 172.21.15.47:0/1337718405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37bc101d80 0x7f37bc102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.821+0000 7f37c356a700 1 -- 172.21.15.47:0/1337718405 >> 172.21.15.47:0/1337718405 conn(0x7f37bc076550 msgr2=0x7f37bc076960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.822+0000 7f37c356a700 1 -- 172.21.15.47:0/1337718405 shutdown_connections 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.822+0000 7f37c356a700 1 -- 172.21.15.47:0/1337718405 wait complete. 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.822+0000 7f37c356a700 1 Processor -- start 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.822+0000 7f37c356a700 1 -- start start 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.822+0000 7f37c356a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37bc101d80 0x7f37bc19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.822+0000 7f37c356a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37bc102740 0x7f37bc19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c356a700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f37bc106200 0x7f37bc19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c356a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc10fb20 con 0x7f37bc101d80 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c356a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc10f9a0 con 0x7f37bc102740 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c356a700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f37bc10fca0 con 0x7f37bc106200 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37bc101d80 0x7f37bc19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1b07700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f37bc106200 0x7f37bc19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37bc101d80 0x7f37bc19a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56186/0 (socket says 172.21.15.47:56186) 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 -- 172.21.15.47:0/4091042905 learned_addr learned my addr 172.21.15.47:0/4091042905 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 -- 172.21.15.47:0/4091042905 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f37bc106200 msgr2=0x7f37bc19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 --2- 172.21.15.47:0/4091042905 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f37bc106200 0x7f37bc19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 -- 172.21.15.47:0/4091042905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37bc102740 msgr2=0x7f37bc19a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 --2- 172.21.15.47:0/4091042905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37bc102740 0x7f37bc19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 -- 172.21.15.47:0/4091042905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc19f310 con 0x7f37bc101d80 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c1306700 1 --2- 172.21.15.47:0/4091042905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37bc101d80 0x7f37bc19a300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005320 tx=0x7f37b0005350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37ae7fc700 1 -- 172.21.15.47:0/4091042905 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0023020 con 0x7f37bc101d80 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37ae7fc700 1 -- 172.21.15.47:0/4091042905 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f37b000de40 con 0x7f37bc101d80 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc19f5a0 con 0x7f37bc101d80 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37ae7fc700 1 -- 172.21.15.47:0/4091042905 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b001f460 con 0x7f37bc101d80 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.823+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37bc1a6e80 con 0x7f37bc101d80 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.824+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37bc068f90 con 0x7f37bc101d80 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.825+0000 7f37ae7fc700 1 -- 172.21.15.47:0/4091042905 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f37b0026020 con 0x7f37bc101d80 2024-04-06T03:33:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.825+0000 7f37ae7fc700 1 --2- 172.21.15.47:0/4091042905 >> v2:172.21.15.47:6800/850698093 conn(0x7f37a806db10 0x7f37a806ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:39.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.825+0000 7f37c0b05700 1 --2- 172.21.15.47:0/4091042905 >> v2:172.21.15.47:6800/850698093 conn(0x7f37a806db10 0x7f37a806ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:39.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.825+0000 7f37ae7fc700 1 -- 172.21.15.47:0/4091042905 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4081+0+0 (secure 0 0 0) 0x7f37b0011020 con 0x7f37bc101d80 2024-04-06T03:33:39.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.826+0000 7f37c0b05700 1 --2- 172.21.15.47:0/4091042905 >> v2:172.21.15.47:6800/850698093 conn(0x7f37a806db10 0x7f37a806ffd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37b8005fd0 tx=0x7f37b8005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:39.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:39.830+0000 7f37ae7fc700 1 -- 172.21.15.47:0/4091042905 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f37b005c730 con 0x7f37bc101d80 2024-04-06T03:33:40.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.035+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37bc1a7050 con 0x7f37bc101d80 2024-04-06T03:33:40.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.036+0000 7f37ae7fc700 1 -- 172.21.15.47:0/4091042905 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+11498 (secure 0 0 0) 0x7f37b005c030 con 0x7f37bc101d80 2024-04-06T03:33:40.038 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:33:40.038 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":58,"fsid":"8f6329a8-f3c5-11ee-b649-cb9ed24678a4","created":"2024-04-06T03:28:10.981912+0000","modified":"2024-04-06T03:33:39.877630+0000","last_up_change":"2024-04-06T03:33:35.857014+0000","last_in_change":"2024-04-06T03:33:18.570369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-06T03:31:32.766604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ec002d7-209e-4bd2-850f-4c843760e184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6801","nonce":1723574942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1723574942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1723574942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":1723574942}]},"public_addr":"172.21.15.47:6801/1723574942","cluster_addr":"172.21.15.47:6802/1723574942","heartbeat_back_addr":"172.21.15.47:6804/1723574942","heartbeat_front_addr":"172.21.15.47:6803/1723574942","state":["exists","up"]},{"osd":1,"uuid":"d9e6ac29-f4e4-4811-a9a7-d206e26183bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":1617120903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1617120903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1617120903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":1617120903}]},"public_addr":"172.21.15.47:6805/1617120903","cluster_addr":"172.21.15.47:6806/1617120903","heartbeat_back_addr":"172.21.15.47:6808/1617120903","heartbeat_front_addr":"172.21.15.47:6807/1617120903","state":["exists","up"]},{"osd":2,"uuid":"00d98fac-1ce6-4422-98e6-d1ad99cdfaf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1442630653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1442630653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1442630653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":1442630653}]},"public_addr":"172.21.15.47:6809/1442630653","cluster_addr":"172.21.15.47:6810/1442630653","heartbeat_back_addr":"172.21.15.47:6812/1442630653","heartbeat_front_addr":"172.21.15.47:6811/1442630653","state":["exists","up"]},{"osd":3,"uuid":"148e8f94-0638-4af1-9a5e-f8ec0ee2cf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":299519913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":299519913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":299519913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":299519913}]},"public_addr":"172.21.15.47:6813/299519913","cluster_addr":"172.21.15.47:6814/299519913","heartbeat_back_addr":"172.21.15.47:6816/299519913","heartbeat_front_addr":"172.21.15.47:6815/299519913","state":["exists","up"]},{"osd":4,"uuid":"ccfd48fd-61bd-46b4-b83a-c8396e41b3a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1031996030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6801","nonce":1031996030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6803","nonce":1031996030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1031996030}]},"public_addr":"172.21.15.102:6800/1031996030","cluster_addr":"172.21.15.102:6801/1031996030","heartbeat_back_addr":"172.21.15.102:6803/1031996030","heartbeat_front_addr":"172.21.15.102:6802/1031996030","state":["exists","up"]},{"osd":5,"uuid":"1411f970-4f9e-4e08-9222-905c8c91835e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":386919126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6805","nonce":386919126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6807","nonce":386919126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":386919126}]},"public_addr":"172.21.15.102:6804/386919126","cluster_addr":"172.21.15.102:6805/386919126","heartbeat_back_addr":"172.21.15.102:6807/386919126","heartbeat_front_addr":"172.21.15.102:6806/386919126","state":["exists","up"]},{"osd":6,"uuid":"1369f589-dc4c-4cd8-94c2-7e89b44fa548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":4105297178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":4105297178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":4105297178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4105297178}]},"public_addr":"172.21.15.102:6808/4105297178","cluster_addr":"172.21.15.102:6809/4105297178","heartbeat_back_addr":"172.21.15.102:6811/4105297178","heartbeat_front_addr":"172.21.15.102:6810/4105297178","state":["exists","up"]},{"osd":7,"uuid":"c782d6e2-04f7-462f-9f3e-ca539b5d8256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3557443636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3557443636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":3557443636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3557443636}]},"public_addr":"172.21.15.102:6812/3557443636","cluster_addr":"172.21.15.102:6813/3557443636","heartbeat_back_addr":"172.21.15.102:6815/3557443636","heartbeat_front_addr":"172.21.15.102:6814/3557443636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:30:38.617682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:03.457695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:29.382721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:55.764293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:32:19.310003+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:32:44.054598+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:33:08.591126+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:33:34.758478+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/2499466181":"2024-04-07T03:29:14.432037+0000","172.21.15.47:6800/4248661693":"2024-04-07T03:29:14.432037+0000","172.21.15.47:0/3946620428":"2024-04-07T03:29:14.432037+0000","172.21.15.47:0/1620211743":"2024-04-07T03:28:47.430977+0000","172.21.15.47:6800/2668596695":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/2300916716":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/1849130368":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/1343743305":"2024-04-07T03:29:14.432037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T03:33:40.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 >> v2:172.21.15.47:6800/850698093 conn(0x7f37a806db10 msgr2=0x7f37a806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:40.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 --2- 172.21.15.47:0/4091042905 >> v2:172.21.15.47:6800/850698093 conn(0x7f37a806db10 0x7f37a806ffd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37b8005fd0 tx=0x7f37b8005d00 comp rx=0 tx=0).stop 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37bc101d80 msgr2=0x7f37bc19a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 --2- 172.21.15.47:0/4091042905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37bc101d80 0x7f37bc19a300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005320 tx=0x7f37b0005350 comp rx=0 tx=0).stop 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 shutdown_connections 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 --2- 172.21.15.47:0/4091042905 >> v2:172.21.15.47:6800/850698093 conn(0x7f37a806db10 0x7f37a806ffd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 --2- 172.21.15.47:0/4091042905 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f37bc106200 0x7f37bc19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 --2- 172.21.15.47:0/4091042905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37bc101d80 0x7f37bc19a300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 --2- 172.21.15.47:0/4091042905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37bc102740 0x7f37bc19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 >> 172.21.15.47:0/4091042905 conn(0x7f37bc076550 msgr2=0x7f37bc104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 shutdown_connections 2024-04-06T03:33:40.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:40.038+0000 7f37c356a700 1 -- 172.21.15.47:0/4091042905 wait complete. 2024-04-06T03:33:40.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:39 smithi047 ceph-mon[29365]: osdmap e57: 8 total, 8 up, 8 in 2024-04-06T03:33:40.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:39 smithi047 ceph-mon[37680]: osdmap e57: 8 total, 8 up, 8 in 2024-04-06T03:33:40.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:39 smithi102 ceph-mon[32821]: osdmap e57: 8 total, 8 up, 8 in 2024-04-06T03:33:40.697 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-06T03:31:32.766604+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-06T03:33:40.697 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd pool get .mgr pg_num 2024-04-06T03:33:40.944 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:33:40.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:40 smithi047 ceph-mon[29365]: osdmap e58: 8 total, 8 up, 8 in 2024-04-06T03:33:40.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4091042905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:33:40.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:40 smithi047 ceph-mon[29365]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:40 smithi047 ceph-mon[37680]: osdmap e58: 8 total, 8 up, 8 in 2024-04-06T03:33:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4091042905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:33:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:40 smithi047 ceph-mon[37680]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:41.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:40 smithi102 ceph-mon[32821]: osdmap e58: 8 total, 8 up, 8 in 2024-04-06T03:33:41.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4091042905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:33:41.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:40 smithi102 ceph-mon[32821]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:42.695 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:42 smithi047 ceph-mon[29365]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-06T03:33:42.695 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:42 smithi047 ceph-mon[37680]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-06T03:33:42.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 -- 172.21.15.47:0/3666007800 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 msgr2=0x7f925410f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:42.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 --2- 172.21.15.47:0/3666007800 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 0x7f925410f1a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f924c00b0d0 tx=0x7f924c00b3e0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 -- 172.21.15.47:0/3666007800 shutdown_connections 2024-04-06T03:33:42.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 --2- 172.21.15.47:0/3666007800 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 0x7f925410f1a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 --2- 172.21.15.47:0/3666007800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9254102580 0x7f9254102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 --2- 172.21.15.47:0/3666007800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9254102f30 0x7f9254106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 -- 172.21.15.47:0/3666007800 >> 172.21.15.47:0/3666007800 conn(0x7f9254079430 msgr2=0x7f9254079840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:42.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 -- 172.21.15.47:0/3666007800 shutdown_connections 2024-04-06T03:33:42.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.721+0000 7f925aa86700 1 -- 172.21.15.47:0/3666007800 wait complete. 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f925aa86700 1 Processor -- start 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f925aa86700 1 -- start start 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f925aa86700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9254102580 0x7f9254198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f925aa86700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9254102f30 0x7f9254198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f925aa86700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 0x7f925419c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f925aa86700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9254111cf0 con 0x7f9254102f30 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f925aa86700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9254111b70 con 0x7f9254102580 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f925aa86700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f9254111e70 con 0x7f92541075d0 2024-04-06T03:33:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9253fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9254102f30 0x7f9254198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9253fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9254102f30 0x7f9254198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56190/0 (socket says 172.21.15.47:56190) 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9253fff700 1 -- 172.21.15.47:0/1419487339 learned_addr learned my addr 172.21.15.47:0/1419487339 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9259023700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 0x7f925419c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9258822700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9254102580 0x7f9254198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9253fff700 1 -- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 msgr2=0x7f925419c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9253fff700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 0x7f925419c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9253fff700 1 -- 172.21.15.47:0/1419487339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9254102580 msgr2=0x7f9254198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9253fff700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9254102580 0x7f9254198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9253fff700 1 -- 172.21.15.47:0/1419487339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925419d050 con 0x7f9254102f30 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.722+0000 7f9259023700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 0x7f925419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.723+0000 7f9253fff700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9254102f30 0x7f9254198580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f924000c9e0 tx=0x7f924000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.723+0000 7f9251ffb700 1 -- 172.21.15.47:0/1419487339 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240007aa0 con 0x7f9254102f30 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.723+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925419d340 con 0x7f9254102f30 2024-04-06T03:33:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.723+0000 7f9251ffb700 1 -- 172.21.15.47:0/1419487339 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f9240007c40 con 0x7f9254102f30 2024-04-06T03:33:42.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.723+0000 7f9251ffb700 1 -- 172.21.15.47:0/1419487339 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240018660 con 0x7f9254102f30 2024-04-06T03:33:42.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.723+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92541a4bc0 con 0x7f9254102f30 2024-04-06T03:33:42.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.724+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9254068f90 con 0x7f9254102f30 2024-04-06T03:33:42.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.724+0000 7f9251ffb700 1 -- 172.21.15.47:0/1419487339 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f924000f450 con 0x7f9254102f30 2024-04-06T03:33:42.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.725+0000 7f9251ffb700 1 --2- 172.21.15.47:0/1419487339 >> v2:172.21.15.47:6800/850698093 conn(0x7f924406db10 0x7f924406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:42.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.725+0000 7f9251ffb700 1 -- 172.21.15.47:0/1419487339 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4081+0+0 (secure 0 0 0) 0x7f924008d020 con 0x7f9254102f30 2024-04-06T03:33:42.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.725+0000 7f9258822700 1 --2- 172.21.15.47:0/1419487339 >> v2:172.21.15.47:6800/850698093 conn(0x7f924406db10 0x7f924406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:42.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.725+0000 7f9258822700 1 --2- 172.21.15.47:0/1419487339 >> v2:172.21.15.47:6800/850698093 conn(0x7f924406db10 0x7f924406ffd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9248009680 tx=0x7f9248009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:42.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.730+0000 7f9251ffb700 1 -- 172.21.15.47:0/1419487339 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9240014030 con 0x7f9254102f30 2024-04-06T03:33:42.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:42 smithi102 ceph-mon[32821]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-06T03:33:42.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.932+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f92541a4e50 con 0x7f9254102f30 2024-04-06T03:33:42.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.932+0000 7f9251ffb700 1 -- 172.21.15.47:0/1419487339 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) ==== 93+0+10 (secure 0 0 0) 0x7f924005b380 con 0x7f9254102f30 2024-04-06T03:33:42.934 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 >> v2:172.21.15.47:6800/850698093 conn(0x7f924406db10 msgr2=0x7f924406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 --2- 172.21.15.47:0/1419487339 >> v2:172.21.15.47:6800/850698093 conn(0x7f924406db10 0x7f924406ffd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9248009680 tx=0x7f9248009260 comp rx=0 tx=0).stop 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9254102f30 msgr2=0x7f9254198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9254102f30 0x7f9254198580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f924000c9e0 tx=0x7f924000ccf0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 shutdown_connections 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 --2- 172.21.15.47:0/1419487339 >> v2:172.21.15.47:6800/850698093 conn(0x7f924406db10 0x7f924406ffd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92541075d0 0x7f925419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9254102580 0x7f9254198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 --2- 172.21.15.47:0/1419487339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9254102f30 0x7f9254198580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 >> 172.21.15.47:0/1419487339 conn(0x7f9254079430 msgr2=0x7f9254106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 shutdown_connections 2024-04-06T03:33:42.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:33:42.934+0000 7f925aa86700 1 -- 172.21.15.47:0/1419487339 wait complete. 2024-04-06T03:33:43.566 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1419487339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T03:33:43.566 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1419487339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T03:33:43.596 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi047 2024-04-06T03:33:43.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch apply rgw foo.a --placement '1;smithi047=foo.a' 2024-04-06T03:33:43.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1419487339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T03:33:43.846 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:33:44.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:44 smithi102 ceph-mon[32821]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-06T03:33:44.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:44 smithi047 ceph-mon[29365]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-06T03:33:44.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:44 smithi047 ceph-mon[37680]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-06T03:33:45.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 -- 172.21.15.102:0/1904704923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 msgr2=0x7f1570100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:45.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 --2- 172.21.15.102:0/1904704923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 0x7f1570100a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f156c009990 tx=0x7f156c009ca0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 -- 172.21.15.102:0/1904704923 shutdown_connections 2024-04-06T03:33:45.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 --2- 172.21.15.102:0/1904704923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1570103f60 0x7f157010a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 --2- 172.21.15.102:0/1904704923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 0x7f1570100a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 --2- 172.21.15.102:0/1904704923 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15701035c0 0x7f1570103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 -- 172.21.15.102:0/1904704923 >> 172.21.15.102:0/1904704923 conn(0x7f15700fbf20 msgr2=0x7f15700fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 -- 172.21.15.102:0/1904704923 shutdown_connections 2024-04-06T03:33:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.396+0000 7f157786c700 1 -- 172.21.15.102:0/1904704923 wait complete. 2024-04-06T03:33:45.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f157786c700 1 Processor -- start 2024-04-06T03:33:45.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f157786c700 1 -- start start 2024-04-06T03:33:45.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f157786c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 0x7f1570199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f157786c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15701035c0 0x7f157019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f157786c700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1570103f60 0x7f15701a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f157786c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f157010d6d0 con 0x7f15701035c0 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f157786c700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f157010d550 con 0x7f15701005e0 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f157786c700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f157010d850 con 0x7f1570103f60 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 0x7f1570199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 0x7f1570199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50870/0 (socket says 172.21.15.102:50870) 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 -- 172.21.15.102:0/1542370894 learned_addr learned my addr 172.21.15.102:0/1542370894 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1574e07700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15701035c0 0x7f157019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575e09700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1570103f60 0x7f15701a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 -- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1570103f60 msgr2=0x7f15701a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1570103f60 0x7f15701a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 -- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15701035c0 msgr2=0x7f157019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15701035c0 0x7f157019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 -- 172.21.15.102:0/1542370894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15701a1be0 con 0x7f15701005e0 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1574e07700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15701035c0 0x7f157019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.397+0000 7f1575608700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 0x7f1570199f80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c010 tx=0x7f156c0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.398+0000 7f15667fc700 1 -- 172.21.15.102:0/1542370894 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c027070 con 0x7f15701005e0 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.398+0000 7f15667fc700 1 -- 172.21.15.102:0/1542370894 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f156c022470 con 0x7f15701005e0 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.398+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15701a1e70 con 0x7f15701005e0 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.398+0000 7f15667fc700 1 -- 172.21.15.102:0/1542370894 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c00f6c0 con 0x7f15701005e0 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.398+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15701a2290 con 0x7f15701005e0 2024-04-06T03:33:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.399+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1570068f90 con 0x7f15701005e0 2024-04-06T03:33:45.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.399+0000 7f15667fc700 1 -- 172.21.15.102:0/1542370894 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f156c02a070 con 0x7f15701005e0 2024-04-06T03:33:45.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.400+0000 7f15667fc700 1 --2- 172.21.15.102:0/1542370894 >> v2:172.21.15.47:6800/850698093 conn(0x7f155c06db10 0x7f155c06ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:45.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.400+0000 7f15667fc700 1 -- 172.21.15.102:0/1542370894 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4081+0+0 (secure 0 0 0) 0x7f156c08e270 con 0x7f15701005e0 2024-04-06T03:33:45.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.400+0000 7f1574e07700 1 --2- 172.21.15.102:0/1542370894 >> v2:172.21.15.47:6800/850698093 conn(0x7f155c06db10 0x7f155c06ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:45.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.400+0000 7f1574e07700 1 --2- 172.21.15.102:0/1542370894 >> v2:172.21.15.47:6800/850698093 conn(0x7f155c06db10 0x7f155c06ffd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15600099d0 tx=0x7f1560008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:45.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.404+0000 7f15667fc700 1 -- 172.21.15.102:0/1542370894 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f156c013070 con 0x7f15701005e0 2024-04-06T03:33:45.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.611+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi047=foo.a", "target": ["mon-mgr", ""]}) -- 0x7f15701023c0 con 0x7f155c06db10 2024-04-06T03:33:45.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.618+0000 7f15667fc700 1 -- 172.21.15.102:0/1542370894 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f15701023c0 con 0x7f155c06db10 2024-04-06T03:33:45.622 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled rgw.foo.a update... 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 >> v2:172.21.15.47:6800/850698093 conn(0x7f155c06db10 msgr2=0x7f155c06ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 --2- 172.21.15.102:0/1542370894 >> v2:172.21.15.47:6800/850698093 conn(0x7f155c06db10 0x7f155c06ffd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15600099d0 tx=0x7f1560008040 comp rx=0 tx=0).stop 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 msgr2=0x7f1570199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 0x7f1570199f80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c010 tx=0x7f156c0047b0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 shutdown_connections 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 --2- 172.21.15.102:0/1542370894 >> v2:172.21.15.47:6800/850698093 conn(0x7f155c06db10 0x7f155c06ffd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1570103f60 0x7f15701a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15701005e0 0x7f1570199f80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 --2- 172.21.15.102:0/1542370894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15701035c0 0x7f157019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 >> 172.21.15.102:0/1542370894 conn(0x7f15700fbf20 msgr2=0x7f15700fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 shutdown_connections 2024-04-06T03:33:45.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:45.621+0000 7f157786c700 1 -- 172.21.15.102:0/1542370894 wait complete. 2024-04-06T03:33:46.331 DEBUG:teuthology.orchestra.run.smithi047:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@rgw.foo.a.service 2024-04-06T03:33:46.333 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi102 2024-04-06T03:33:46.334 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd pool create datapool 3 3 replicated 2024-04-06T03:33:46.567 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:33:46.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi047=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:46.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: Saving service rgw.foo.a spec with placement smithi047=foo.a;count:1 2024-04-06T03:33:46.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:46.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:46.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:46.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: Deploying daemon rgw.foo.a on smithi047 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[29365]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi047=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: Saving service rgw.foo.a spec with placement smithi047=foo.a;count:1 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:46.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: Deploying daemon rgw.foo.a on smithi047 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:46 smithi047 ceph-mon[37680]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:33:46.924 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi047=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: Saving service rgw.foo.a spec with placement smithi047=foo.a;count:1 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: Deploying daemon rgw.foo.a on smithi047 2024-04-06T03:33:46.925 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:46 smithi102 ceph-mon[32821]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-06T03:33:48.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 -- 172.21.15.102:0/2875826383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c103e90 msgr2=0x7fe92c10a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:48.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 --2- 172.21.15.102:0/2875826383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c103e90 0x7fe92c10a740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0099c0 tx=0x7fe91c009cd0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 -- 172.21.15.102:0/2875826383 shutdown_connections 2024-04-06T03:33:48.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 --2- 172.21.15.102:0/2875826383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c103e90 0x7fe92c10a740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 --2- 172.21.15.102:0/2875826383 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe92c1022f0 0x7fe92c102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 --2- 172.21.15.102:0/2875826383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe92c1034f0 0x7fe92c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 -- 172.21.15.102:0/2875826383 >> 172.21.15.102:0/2875826383 conn(0x7fe92c0fd8b0 msgr2=0x7fe92c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 -- 172.21.15.102:0/2875826383 shutdown_connections 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.167+0000 7fe932b21700 1 -- 172.21.15.102:0/2875826383 wait complete. 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe932b21700 1 Processor -- start 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe932b21700 1 -- start start 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe932b21700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe92c1022f0 0x7fe92c197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe932b21700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c1034f0 0x7fe92c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe932b21700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe92c103e90 0x7fe92c19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe932b21700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c10d6d0 con 0x7fe92c103e90 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe932b21700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c10d550 con 0x7fe92c1034f0 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe932b21700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c10d850 con 0x7fe92c1022f0 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c1034f0 0x7fe92c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c1034f0 0x7fe92c1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47354/0 (socket says 172.21.15.102:47354) 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe92bfff700 1 -- 172.21.15.102:0/2512684922 learned_addr learned my addr 172.21.15.102:0/2512684922 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe9310be700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe92c103e90 0x7fe92c19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:48.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe9308bd700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe92c1022f0 0x7fe92c197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe92bfff700 1 -- 172.21.15.102:0/2512684922 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe92c1022f0 msgr2=0x7fe92c197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe92bfff700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe92c1022f0 0x7fe92c197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe92bfff700 1 -- 172.21.15.102:0/2512684922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe92c103e90 msgr2=0x7fe92c19f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe92bfff700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe92c103e90 0x7fe92c19f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.168+0000 7fe92bfff700 1 -- 172.21.15.102:0/2512684922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c19f9b0 con 0x7fe92c1034f0 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.169+0000 7fe92bfff700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c1034f0 0x7fe92c1982e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe92000b530 tx=0x7fe92000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.169+0000 7fe929ffb700 1 -- 172.21.15.102:0/2512684922 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920015020 con 0x7fe92c1034f0 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.169+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c19fca0 con 0x7fe92c1034f0 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.169+0000 7fe929ffb700 1 -- 172.21.15.102:0/2512684922 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe920011ce0 con 0x7fe92c1034f0 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.169+0000 7fe929ffb700 1 -- 172.21.15.102:0/2512684922 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920010dd0 con 0x7fe92c1034f0 2024-04-06T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.169+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c1a0250 con 0x7fe92c1034f0 2024-04-06T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.170+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92c068f90 con 0x7fe92c1034f0 2024-04-06T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.170+0000 7fe929ffb700 1 -- 172.21.15.102:0/2512684922 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7fe920018020 con 0x7fe92c1034f0 2024-04-06T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.171+0000 7fe929ffb700 1 --2- 172.21.15.102:0/2512684922 >> v2:172.21.15.47:6800/850698093 conn(0x7fe91406db10 0x7fe91406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.171+0000 7fe929ffb700 1 -- 172.21.15.102:0/2512684922 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4081+0+0 (secure 0 0 0) 0x7fe92008c7a0 con 0x7fe92c1034f0 2024-04-06T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.171+0000 7fe9308bd700 1 --2- 172.21.15.102:0/2512684922 >> v2:172.21.15.47:6800/850698093 conn(0x7fe91406db10 0x7fe91406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.171+0000 7fe9308bd700 1 --2- 172.21.15.102:0/2512684922 >> v2:172.21.15.47:6800/850698093 conn(0x7fe91406db10 0x7fe91406ffd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe92c103350 tx=0x7fe92400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.175+0000 7fe929ffb700 1 -- 172.21.15.102:0/2512684922 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe92001f020 con 0x7fe92c1034f0 2024-04-06T03:33:48.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.369+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) -- 0x7fe92c062ee0 con 0x7fe92c1034f0 2024-04-06T03:33:48.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.675+0000 7fe929ffb700 1 -- 172.21.15.102:0/2512684922 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v59) ==== 160+0+0 (secure 0 0 0) 0x7fe92005aba0 con 0x7fe92c1034f0 2024-04-06T03:33:48.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 >> v2:172.21.15.47:6800/850698093 conn(0x7fe91406db10 msgr2=0x7fe91406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:48.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 --2- 172.21.15.102:0/2512684922 >> v2:172.21.15.47:6800/850698093 conn(0x7fe91406db10 0x7fe91406ffd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe92c103350 tx=0x7fe92400d040 comp rx=0 tx=0).stop 2024-04-06T03:33:48.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c1034f0 msgr2=0x7fe92c1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:48.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c1034f0 0x7fe92c1982e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe92000b530 tx=0x7fe92000b840 comp rx=0 tx=0).stop 2024-04-06T03:33:48.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 shutdown_connections 2024-04-06T03:33:48.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 --2- 172.21.15.102:0/2512684922 >> v2:172.21.15.47:6800/850698093 conn(0x7fe91406db10 0x7fe91406ffd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe92c103e90 0x7fe92c19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe92c1022f0 0x7fe92c197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 --2- 172.21.15.102:0/2512684922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe92c1034f0 0x7fe92c1982e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:48.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 >> 172.21.15.102:0/2512684922 conn(0x7fe92c0fd8b0 msgr2=0x7fe92c0ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:48.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 shutdown_connections 2024-04-06T03:33:48.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:48.677+0000 7fe932b21700 1 -- 172.21.15.102:0/2512684922 wait complete. 2024-04-06T03:33:48.680 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'datapool' created 2024-04-06T03:33:48.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/2512684922' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-06T03:33:48.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-06T03:33:48.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:48 smithi047 ceph-mon[29365]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-06T03:33:48.837 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/2512684922' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-06T03:33:48.837 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-06T03:33:48.837 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:48 smithi047 ceph-mon[37680]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-06T03:33:48.837 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 03:33:48 smithi047 podman[64078]: 2024-04-06 03:33:48.771681684 +0000 UTC m=+0.362365427 container start 22b1a13ee6a69e1f792baec461fd5e7c35c0cf2e8a9bdd088cf1bf0b9441dfb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-rgw-foo-a, org.label-schema.vendor=CentOS, RELEASE=squid-9f19235, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-06T03:33:48.837 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 03:33:48 smithi047 bash[64078]: 22b1a13ee6a69e1f792baec461fd5e7c35c0cf2e8a9bdd088cf1bf0b9441dfb9 2024-04-06T03:33:48.984 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/2512684922' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-06T03:33:48.984 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-06T03:33:48.984 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:48 smithi102 ceph-mon[32821]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-06T03:33:49.243 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 03:33:48 smithi047 systemd[1]: Started Ceph rgw.foo.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:33:49.320 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- rbd pool init datapool 2024-04-06T03:33:49.557 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: osdmap e59: 8 total, 8 up, 8 in 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: Saving service rgw.foo.a spec with placement smithi047=foo.a;count:1 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:49.989 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:49 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: osdmap e59: 8 total, 8 up, 8 in 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: Saving service rgw.foo.a spec with placement smithi047=foo.a;count:1 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: osdmap e59: 8 total, 8 up, 8 in 2024-04-06T03:33:49.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: Saving service rgw.foo.a spec with placement smithi047=foo.a;count:1 2024-04-06T03:33:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:33:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:49 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:50.954 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:50 smithi102 ceph-mon[32821]: osdmap e60: 8 total, 8 up, 8 in 2024-04-06T03:33:50.954 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2237462939' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-06T03:33:50.954 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-06T03:33:50.954 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:50 smithi102 ceph-mon[32821]: pgmap v188: 36 pgs: 35 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:50.954 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-04-06T03:33:50.954 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:50 smithi102 ceph-mon[32821]: osdmap e61: 8 total, 8 up, 8 in 2024-04-06T03:33:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[29365]: osdmap e60: 8 total, 8 up, 8 in 2024-04-06T03:33:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2237462939' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-06T03:33:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-06T03:33:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[29365]: pgmap v188: 36 pgs: 35 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-04-06T03:33:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[29365]: osdmap e61: 8 total, 8 up, 8 in 2024-04-06T03:33:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[37680]: osdmap e60: 8 total, 8 up, 8 in 2024-04-06T03:33:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2237462939' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-06T03:33:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-06T03:33:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[37680]: pgmap v188: 36 pgs: 35 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:33:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-04-06T03:33:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:50 smithi047 ceph-mon[37680]: osdmap e61: 8 total, 8 up, 8 in 2024-04-06T03:33:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:33:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: Checking dashboard <-> RGW credentials 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/1268117023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: osdmap e62: 8 total, 8 up, 8 in 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[37680]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:33:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: Checking dashboard <-> RGW credentials 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/1268117023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: osdmap e62: 8 total, 8 up, 8 in 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:51 smithi047 ceph-mon[29365]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:33:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: Checking dashboard <-> RGW credentials 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/1268117023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: osdmap e62: 8 total, 8 up, 8 in 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:51 smithi102 ceph-mon[32821]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-06T03:33:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:52 smithi047 ceph-mon[37680]: pgmap v191: 68 pgs: 22 active+clean, 9 creating+peering, 37 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:33:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-06T03:33:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:52 smithi047 ceph-mon[37680]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-06T03:33:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:52 smithi047 ceph-mon[37680]: osdmap e63: 8 total, 8 up, 8 in 2024-04-06T03:33:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:52 smithi047 ceph-mon[29365]: pgmap v191: 68 pgs: 22 active+clean, 9 creating+peering, 37 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:33:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-06T03:33:52.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:52 smithi047 ceph-mon[29365]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-06T03:33:52.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:52 smithi047 ceph-mon[29365]: osdmap e63: 8 total, 8 up, 8 in 2024-04-06T03:33:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:52 smithi102 ceph-mon[32821]: pgmap v191: 68 pgs: 22 active+clean, 9 creating+peering, 37 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:33:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-06T03:33:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:52 smithi102 ceph-mon[32821]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-06T03:33:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:52 smithi102 ceph-mon[32821]: osdmap e63: 8 total, 8 up, 8 in 2024-04-06T03:33:54.332 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.102 --placement '1;smithi102=iscsi.a' 2024-04-06T03:33:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:33:54.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:54 smithi102 ceph-mon[32821]: osdmap e64: 8 total, 8 up, 8 in 2024-04-06T03:33:54.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:54 smithi102 ceph-mon[32821]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.939 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:54 smithi102 ceph-mon[32821]: pgmap v194: 100 pgs: 28 active+clean, 16 creating+peering, 56 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:33:54.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[29365]: osdmap e64: 8 total, 8 up, 8 in 2024-04-06T03:33:54.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[29365]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[29365]: pgmap v194: 100 pgs: 28 active+clean, 16 creating+peering, 56 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:33:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[37680]: osdmap e64: 8 total, 8 up, 8 in 2024-04-06T03:33:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[37680]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-06T03:33:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:54 smithi047 ceph-mon[37680]: pgmap v194: 100 pgs: 28 active+clean, 16 creating+peering, 56 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:33:55.960 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-06T03:33:55.960 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:55 smithi102 ceph-mon[32821]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-06T03:33:55.960 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:55 smithi102 ceph-mon[32821]: osdmap e65: 8 total, 8 up, 8 in 2024-04-06T03:33:55.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-06T03:33:55.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:55 smithi047 ceph-mon[29365]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-06T03:33:55.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:55 smithi047 ceph-mon[29365]: osdmap e65: 8 total, 8 up, 8 in 2024-04-06T03:33:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-06T03:33:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:55 smithi047 ceph-mon[37680]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-06T03:33:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:55 smithi047 ceph-mon[37680]: osdmap e65: 8 total, 8 up, 8 in 2024-04-06T03:33:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 -- 172.21.15.102:0/1336846912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103520 msgr2=0x7f478c103980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 --2- 172.21.15.102:0/1336846912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103520 0x7f478c103980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f477c0099c0 tx=0x7f477c009cd0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 -- 172.21.15.102:0/1336846912 shutdown_connections 2024-04-06T03:33:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 --2- 172.21.15.102:0/1336846912 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f478c103ec0 0x7f478c10a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 --2- 172.21.15.102:0/1336846912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f478c102320 0x7f478c102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 --2- 172.21.15.102:0/1336846912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103520 0x7f478c103980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 -- 172.21.15.102:0/1336846912 >> 172.21.15.102:0/1336846912 conn(0x7f478c0fd8e0 msgr2=0x7f478c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 -- 172.21.15.102:0/1336846912 shutdown_connections 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 -- 172.21.15.102:0/1336846912 wait complete. 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 Processor -- start 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.192+0000 7f479365a700 1 -- start start 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f479365a700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f478c102320 0x7f478c076070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f479365a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f478c103520 0x7f478c0746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f479365a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103ec0 0x7f478c074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f479365a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f478c10d690 con 0x7f478c103520 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f479365a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f478c10d510 con 0x7f478c103ec0 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f479365a700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f478c10d810 con 0x7f478c102320 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103ec0 0x7f478c074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103ec0 0x7f478c074c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44128/0 (socket says 172.21.15.102:44128) 2024-04-06T03:33:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 -- 172.21.15.102:0/334974364 learned_addr learned my addr 172.21.15.102:0/334974364 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f47913f6700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f478c102320 0x7f478c076070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4790bf5700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f478c103520 0x7f478c0746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 -- 172.21.15.102:0/334974364 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f478c102320 msgr2=0x7f478c076070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f478c102320 0x7f478c076070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 -- 172.21.15.102:0/334974364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f478c103520 msgr2=0x7f478c0746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f478c103520 0x7f478c0746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 -- 172.21.15.102:0/334974364 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c0754b0 con 0x7f478c103ec0 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f4791bf7700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103ec0 0x7f478c074c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f478400ada0 tx=0x7f478400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f47827fc700 1 -- 172.21.15.102:0/334974364 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784017020 con 0x7f478c103ec0 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c1a1ce0 con 0x7f478c103ec0 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f47827fc700 1 -- 172.21.15.102:0/334974364 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f478400cd80 con 0x7f478c103ec0 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f47827fc700 1 -- 172.21.15.102:0/334974364 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784005280 con 0x7f478c103ec0 2024-04-06T03:33:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.193+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c1a21c0 con 0x7f478c103ec0 2024-04-06T03:33:56.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.194+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478c0507e0 con 0x7f478c103ec0 2024-04-06T03:33:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.195+0000 7f47827fc700 1 -- 172.21.15.102:0/334974364 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f478400c8d0 con 0x7f478c103ec0 2024-04-06T03:33:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.195+0000 7f47827fc700 1 --2- 172.21.15.102:0/334974364 >> v2:172.21.15.47:6800/850698093 conn(0x7f477806dbb0 0x7f4778070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.195+0000 7f47827fc700 1 -- 172.21.15.102:0/334974364 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5915+0+0 (secure 0 0 0) 0x7f478408d030 con 0x7f478c103ec0 2024-04-06T03:33:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.195+0000 7f47913f6700 1 --2- 172.21.15.102:0/334974364 >> v2:172.21.15.47:6800/850698093 conn(0x7f477806dbb0 0x7f4778070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.196+0000 7f47913f6700 1 --2- 172.21.15.102:0/334974364 >> v2:172.21.15.47:6800/850698093 conn(0x7f477806dbb0 0x7f4778070070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f478c103380 tx=0x7f478800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:56.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.200+0000 7f47827fc700 1 -- 172.21.15.102:0/334974364 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4784021020 con 0x7f478c103ec0 2024-04-06T03:33:56.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.410+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.102", "placement": "1;smithi102=iscsi.a", "target": ["mon-mgr", ""]}) -- 0x7f478c062710 con 0x7f477806dbb0 2024-04-06T03:33:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.418+0000 7f47827fc700 1 -- 172.21.15.102:0/334974364 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+35 (secure 0 0 0) 0x7f478c062710 con 0x7f477806dbb0 2024-04-06T03:33:56.420 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled iscsi.datapool update... 2024-04-06T03:33:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 >> v2:172.21.15.47:6800/850698093 conn(0x7f477806dbb0 msgr2=0x7f4778070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 --2- 172.21.15.102:0/334974364 >> v2:172.21.15.47:6800/850698093 conn(0x7f477806dbb0 0x7f4778070070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f478c103380 tx=0x7f478800a380 comp rx=0 tx=0).stop 2024-04-06T03:33:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103ec0 msgr2=0x7f478c074c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103ec0 0x7f478c074c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f478400ada0 tx=0x7f478400c330 comp rx=0 tx=0).stop 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 shutdown_connections 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 --2- 172.21.15.102:0/334974364 >> v2:172.21.15.47:6800/850698093 conn(0x7f477806dbb0 0x7f4778070070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f478c103ec0 0x7f478c074c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f478c102320 0x7f478c076070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 --2- 172.21.15.102:0/334974364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f478c103520 0x7f478c0746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 >> 172.21.15.102:0/334974364 conn(0x7f478c0fd8e0 msgr2=0x7f478c106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 shutdown_connections 2024-04-06T03:33:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:56.420+0000 7f479365a700 1 -- 172.21.15.102:0/334974364 wait complete. 2024-04-06T03:33:56.981 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: osdmap e66: 8 total, 8 up, 8 in 2024-04-06T03:33:56.982 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.982 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.982 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.982 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.982 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.102", "placement": "1;smithi102=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:56.982 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: Saving service iscsi.datapool spec with placement smithi102=iscsi.a;count:1 2024-04-06T03:33:56.982 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:56.982 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:56 smithi102 ceph-mon[32821]: pgmap v197: 132 pgs: 83 active+clean, 26 creating+peering, 23 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: osdmap e66: 8 total, 8 up, 8 in 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.102", "placement": "1;smithi102=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: Saving service iscsi.datapool spec with placement smithi102=iscsi.a;count:1 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[29365]: pgmap v197: 132 pgs: 83 active+clean, 26 creating+peering, 23 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:33:56.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: osdmap e66: 8 total, 8 up, 8 in 2024-04-06T03:33:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-06T03:33:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.102", "placement": "1;smithi102=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: Saving service iscsi.datapool spec with placement smithi102=iscsi.a;count:1 2024-04-06T03:33:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:56 smithi047 ceph-mon[37680]: pgmap v197: 132 pgs: 83 active+clean, 26 creating+peering, 23 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:33:57.009 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-04-06T03:33:57.010 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:33:57.010 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-04-06T03:33:57.040 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:33:57.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-04-06T03:33:57.071 DEBUG:teuthology.orchestra.run.smithi102:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@iscsi.iscsi.a.service 2024-04-06T03:33:57.114 INFO:tasks.cephadm:Adding prometheus.a on smithi102 2024-04-06T03:33:57.114 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch apply prometheus '1;smithi102=a' 2024-04-06T03:33:57.389 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:33:57.768 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:57 smithi102 ceph-mon[32821]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-06T03:33:57.768 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-06T03:33:57.768 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:57 smithi102 ceph-mon[32821]: osdmap e67: 8 total, 8 up, 8 in 2024-04-06T03:33:57.768 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.768 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.768 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:57 smithi102 ceph-mon[32821]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.769 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.769 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:57 smithi102 ceph-mon[32821]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:33:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[29365]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-06T03:33:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-06T03:33:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[29365]: osdmap e67: 8 total, 8 up, 8 in 2024-04-06T03:33:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[29365]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[29365]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:33:57.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[37680]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-06T03:33:57.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-06T03:33:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[37680]: osdmap e67: 8 total, 8 up, 8 in 2024-04-06T03:33:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3823108274' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3392046194' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[37680]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-06T03:33:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:57 smithi047 ceph-mon[37680]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: osdmap e68: 8 total, 8 up, 8 in 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-04-06T03:33:58.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:58.807 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: Deploying daemon iscsi.iscsi.a on smithi102 2024-04-06T03:33:58.807 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:58 smithi102 ceph-mon[32821]: pgmap v200: 132 pgs: 109 active+clean, 18 creating+peering, 5 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: osdmap e68: 8 total, 8 up, 8 in 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: Deploying daemon iscsi.iscsi.a on smithi102 2024-04-06T03:33:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[29365]: pgmap v200: 132 pgs: 109 active+clean, 18 creating+peering, 5 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: osdmap e68: 8 total, 8 up, 8 in 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: Deploying daemon iscsi.iscsi.a on smithi102 2024-04-06T03:33:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:58 smithi047 ceph-mon[37680]: pgmap v200: 132 pgs: 109 active+clean, 18 creating+peering, 5 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:33:59.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 -- 172.21.15.102:0/763100204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 msgr2=0x7f92e4102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:59.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/763100204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 0x7f92e4102720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92e00099c0 tx=0x7f92e0009cd0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 -- 172.21.15.102:0/763100204 shutdown_connections 2024-04-06T03:33:59.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/763100204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92e4103ea0 0x7f92e410a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/763100204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 0x7f92e4102720 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/763100204 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92e4103500 0x7f92e4103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 -- 172.21.15.102:0/763100204 >> 172.21.15.102:0/763100204 conn(0x7f92e40fd8e0 msgr2=0x7f92e40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:59.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 -- 172.21.15.102:0/763100204 shutdown_connections 2024-04-06T03:33:59.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 -- 172.21.15.102:0/763100204 wait complete. 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 Processor -- start 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.017+0000 7f92ec3b3700 1 -- start start 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ec3b3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 0x7f92e4197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ec3b3700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92e4103500 0x7f92e41981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ec3b3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92e4103ea0 0x7f92e419f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ec3b3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f92e410d630 con 0x7f92e4103ea0 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ec3b3700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f92e410d4b0 con 0x7f92e4102300 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ec3b3700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f92e410d7b0 con 0x7f92e4103500 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 0x7f92e4197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 0x7f92e4197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44150/0 (socket says 172.21.15.102:44150) 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 -- 172.21.15.102:0/4293474669 learned_addr learned my addr 172.21.15.102:0/4293474669 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 -- 172.21.15.102:0/4293474669 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92e4103500 msgr2=0x7f92e41981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 --2- 172.21.15.102:0/4293474669 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92e4103500 0x7f92e41981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 -- 172.21.15.102:0/4293474669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92e4103ea0 msgr2=0x7f92e419f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea950700 1 --2- 172.21.15.102:0/4293474669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92e4103ea0 0x7f92e419f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 --2- 172.21.15.102:0/4293474669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92e4103ea0 0x7f92e419f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 -- 172.21.15.102:0/4293474669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e419f8e0 con 0x7f92e4102300 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ea14f700 1 --2- 172.21.15.102:0/4293474669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 0x7f92e4197c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c010 tx=0x7f92e0004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92db7fe700 1 -- 172.21.15.102:0/4293474669 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0027070 con 0x7f92e4102300 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92db7fe700 1 -- 172.21.15.102:0/4293474669 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f92e0022470 con 0x7f92e4102300 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92db7fe700 1 -- 172.21.15.102:0/4293474669 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e000f6c0 con 0x7f92e4102300 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.018+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e419fb70 con 0x7f92e4102300 2024-04-06T03:33:59.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.019+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e419ffc0 con 0x7f92e4102300 2024-04-06T03:33:59.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.019+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e4068f90 con 0x7f92e4102300 2024-04-06T03:33:59.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.020+0000 7f92db7fe700 1 -- 172.21.15.102:0/4293474669 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 91737+0+0 (secure 0 0 0) 0x7f92e002a070 con 0x7f92e4102300 2024-04-06T03:33:59.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.020+0000 7f92db7fe700 1 --2- 172.21.15.102:0/4293474669 >> v2:172.21.15.47:6800/850698093 conn(0x7f92d006db10 0x7f92d006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:33:59.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.020+0000 7f92db7fe700 1 -- 172.21.15.102:0/4293474669 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5942+0+0 (secure 0 0 0) 0x7f92e008ea30 con 0x7f92e4102300 2024-04-06T03:33:59.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.020+0000 7f92e994e700 1 --2- 172.21.15.102:0/4293474669 >> v2:172.21.15.47:6800/850698093 conn(0x7f92d006db10 0x7f92d006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:33:59.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.021+0000 7f92e994e700 1 --2- 172.21.15.102:0/4293474669 >> v2:172.21.15.47:6800/850698093 conn(0x7f92d006db10 0x7f92d006ffd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f92e4199170 tx=0x7f92d4005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:33:59.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.025+0000 7f92db7fe700 1 -- 172.21.15.102:0/4293474669 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f92e0013070 con 0x7f92e4102300 2024-04-06T03:33:59.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.237+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi102=a", "target": ["mon-mgr", ""]}) -- 0x7f92e4062710 con 0x7f92d006db10 2024-04-06T03:33:59.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.245+0000 7f92db7fe700 1 -- 172.21.15.102:0/4293474669 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (secure 0 0 0) 0x7f92e4062710 con 0x7f92d006db10 2024-04-06T03:33:59.247 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled prometheus update... 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 >> v2:172.21.15.47:6800/850698093 conn(0x7f92d006db10 msgr2=0x7f92d006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/4293474669 >> v2:172.21.15.47:6800/850698093 conn(0x7f92d006db10 0x7f92d006ffd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f92e4199170 tx=0x7f92d4005c80 comp rx=0 tx=0).stop 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 msgr2=0x7f92e4197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/4293474669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 0x7f92e4197c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c010 tx=0x7f92e0004790 comp rx=0 tx=0).stop 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 shutdown_connections 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/4293474669 >> v2:172.21.15.47:6800/850698093 conn(0x7f92d006db10 0x7f92d006ffd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/4293474669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92e4103ea0 0x7f92e419f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/4293474669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92e4102300 0x7f92e4197c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 --2- 172.21.15.102:0/4293474669 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f92e4103500 0x7f92e41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 >> 172.21.15.102:0/4293474669 conn(0x7f92e40fd8e0 msgr2=0x7f92e41068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 shutdown_connections 2024-04-06T03:33:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:33:59.248+0000 7f92ec3b3700 1 -- 172.21.15.102:0/4293474669 wait complete. 2024-04-06T03:33:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[29365]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-06T03:33:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[29365]: Cluster is now healthy 2024-04-06T03:33:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[29365]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi102=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[29365]: Saving service prometheus spec with placement smithi102=a;count:1 2024-04-06T03:33:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:33:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[37680]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-06T03:33:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[37680]: Cluster is now healthy 2024-04-06T03:33:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[37680]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi102=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:33:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[37680]: Saving service prometheus spec with placement smithi102=a;count:1 2024-04-06T03:33:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:33:59 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:59 smithi102 ceph-mon[32821]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-06T03:34:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:59 smithi102 ceph-mon[32821]: Cluster is now healthy 2024-04-06T03:34:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:59 smithi102 ceph-mon[32821]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi102=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:59 smithi102 ceph-mon[32821]: Saving service prometheus spec with placement smithi102=a;count:1 2024-04-06T03:34:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:33:59 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:00.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:00 smithi102 ceph-mon[32821]: pgmap v201: 132 pgs: 109 active+clean, 18 creating+peering, 5 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 883 B/s wr, 3 op/s 2024-04-06T03:34:00.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:00 smithi102 systemd[1]: Starting Ceph iscsi.iscsi.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:34:00.922 DEBUG:teuthology.orchestra.run.smithi102:prometheus.a> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@prometheus.a.service 2024-04-06T03:34:00.924 INFO:tasks.cephadm:Adding node-exporter.a on smithi047 2024-04-06T03:34:00.925 INFO:tasks.cephadm:Adding node-exporter.b on smithi102 2024-04-06T03:34:00.925 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch apply node-exporter '2;smithi047=a;smithi102=b' 2024-04-06T03:34:00.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:00 smithi047 ceph-mon[29365]: pgmap v201: 132 pgs: 109 active+clean, 18 creating+peering, 5 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 883 B/s wr, 3 op/s 2024-04-06T03:34:00.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:00 smithi047 ceph-mon[37680]: pgmap v201: 132 pgs: 109 active+clean, 18 creating+peering, 5 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 883 B/s wr, 3 op/s 2024-04-06T03:34:01.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 podman[59852]: 2024-04-06 03:34:01.040662543 +0000 UTC m=+0.018487855 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T03:34:01.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 podman[59852]: 2024-04-06 03:34:01.138414954 +0000 UTC m=+0.116240253 container create afd087c7113678925f06f718cd75b70aeec3ca316d92d5468ff3a35320520e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, RELEASE=squid-9f19235, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-06T03:34:01.584 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 podman[59852]: 2024-04-06 03:34:01.340755441 +0000 UTC m=+0.318580744 container init afd087c7113678925f06f718cd75b70aeec3ca316d92d5468ff3a35320520e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux ) 2024-04-06T03:34:01.584 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 podman[59852]: 2024-04-06 03:34:01.343714378 +0000 UTC m=+0.321539676 container start afd087c7113678925f06f718cd75b70aeec3ca316d92d5468ff3a35320520e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235) 2024-04-06T03:34:01.584 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 bash[59852]: afd087c7113678925f06f718cd75b70aeec3ca316d92d5468ff3a35320520e6a 2024-04-06T03:34:01.584 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 systemd[1]: Started Ceph iscsi.iscsi.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:34:01.903 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug Started the configuration object watcher 2024-04-06T03:34:01.903 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug Checking for config object changes every 1s 2024-04-06T03:34:01.903 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug Processing osd blocklist entries for this node 2024-04-06T03:34:02.026 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:34:02.153 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug Reading the configuration object to update local LIO configuration 2024-04-06T03:34:02.153 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug Configuration does not have an entry for this host(smithi102.front.sepia.ceph.com) - nothing to define to LIO 2024-04-06T03:34:02.153 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2024-04-06T03:34:02.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: Checking pool "datapool" exists for service iscsi.datapool 2024-04-06T03:34:02.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:34:02.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/466422867' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-06T03:34:02.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: osdmap e69: 8 total, 8 up, 8 in 2024-04-06T03:34:02.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:02 smithi102 ceph-mon[32821]: pgmap v203: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s rd, 4.7 KiB/s wr, 202 op/s 2024-04-06T03:34:02.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: Checking pool "datapool" exists for service iscsi.datapool 2024-04-06T03:34:02.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/466422867' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: osdmap e69: 8 total, 8 up, 8 in 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[29365]: pgmap v203: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s rd, 4.7 KiB/s wr, 202 op/s 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: Checking pool "datapool" exists for service iscsi.datapool 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/466422867' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-06T03:34:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: osdmap e69: 8 total, 8 up, 8 in 2024-04-06T03:34:02.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:02 smithi047 ceph-mon[37680]: pgmap v203: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s rd, 4.7 KiB/s wr, 202 op/s 2024-04-06T03:34:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 -- 172.21.15.102:0/3439710145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102da0 msgr2=0x7f74e4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 --2- 172.21.15.102:0/3439710145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102da0 0x7f74e4109650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00b0d0 tx=0x7f74dc00b3e0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 -- 172.21.15.102:0/3439710145 shutdown_connections 2024-04-06T03:34:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 --2- 172.21.15.102:0/3439710145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102da0 0x7f74e4109650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 --2- 172.21.15.102:0/3439710145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101200 0x7f74e4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 --2- 172.21.15.102:0/3439710145 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74e4102400 0x7f74e4102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 -- 172.21.15.102:0/3439710145 >> 172.21.15.102:0/3439710145 conn(0x7f74e40fc7a0 msgr2=0x7f74e40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 -- 172.21.15.102:0/3439710145 shutdown_connections 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.657+0000 7f74eb196700 1 -- 172.21.15.102:0/3439710145 wait complete. 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74eb196700 1 Processor -- start 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74eb196700 1 -- start start 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74eb196700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101200 0x7f74e4196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74eb196700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102400 0x7f74e4197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74eb196700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74e4102da0 0x7f74e419e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74eb196700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f74e410c530 con 0x7f74e4101200 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74eb196700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f74e410c3b0 con 0x7f74e4102400 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74eb196700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f74e410c6b0 con 0x7f74e4102da0 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102400 0x7f74e4197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102400 0x7f74e4197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44246/0 (socket says 172.21.15.102:44246) 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e3fff700 1 -- 172.21.15.102:0/2225157345 learned_addr learned my addr 172.21.15.102:0/2225157345 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e8f32700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101200 0x7f74e4196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e9733700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74e4102da0 0x7f74e419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e3fff700 1 -- 172.21.15.102:0/2225157345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74e4102da0 msgr2=0x7f74e419e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e3fff700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74e4102da0 0x7f74e419e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e3fff700 1 -- 172.21.15.102:0/2225157345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101200 msgr2=0x7f74e4196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e3fff700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101200 0x7f74e4196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.658+0000 7f74e3fff700 1 -- 172.21.15.102:0/2225157345 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e419e720 con 0x7f74e4102400 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.659+0000 7f74e3fff700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102400 0x7f74e4197000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74d000d950 tx=0x7f74d000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.659+0000 7f74e1ffb700 1 -- 172.21.15.102:0/2225157345 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0016070 con 0x7f74e4102400 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.659+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e419ea10 con 0x7f74e4102400 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.659+0000 7f74e1ffb700 1 -- 172.21.15.102:0/2225157345 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f74d000fd40 con 0x7f74e4102400 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.659+0000 7f74e1ffb700 1 -- 172.21.15.102:0/2225157345 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d000e3b0 con 0x7f74e4102400 2024-04-06T03:34:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.659+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e406a150 con 0x7f74e4102400 2024-04-06T03:34:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.660+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e4068f90 con 0x7f74e4102400 2024-04-06T03:34:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.660+0000 7f74e1ffb700 1 -- 172.21.15.102:0/2225157345 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 91788+0+0 (secure 0 0 0) 0x7f74d0019070 con 0x7f74e4102400 2024-04-06T03:34:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.661+0000 7f74e1ffb700 1 --2- 172.21.15.102:0/2225157345 >> v2:172.21.15.47:6800/850698093 conn(0x7f74d406fdb0 0x7f74d4072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.661+0000 7f74e1ffb700 1 -- 172.21.15.102:0/2225157345 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5942+0+0 (secure 0 0 0) 0x7f74d008d410 con 0x7f74e4102400 2024-04-06T03:34:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.661+0000 7f74e8f32700 1 --2- 172.21.15.102:0/2225157345 >> v2:172.21.15.47:6800/850698093 conn(0x7f74d406fdb0 0x7f74d4072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.661+0000 7f74e8f32700 1 --2- 172.21.15.102:0/2225157345 >> v2:172.21.15.47:6800/850698093 conn(0x7f74d406fdb0 0x7f74d4072270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74e4102260 tx=0x7f74d8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.665+0000 7f74e1ffb700 1 -- 172.21.15.102:0/2225157345 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f74d005af30 con 0x7f74e4102400 2024-04-06T03:34:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:03 smithi102 ceph-mon[32821]: mgrmap e16: y(active, since 4m), standbys: x 2024-04-06T03:34:03.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.885+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi047=a;smithi102=b", "target": ["mon-mgr", ""]}) -- 0x7f74e406a440 con 0x7f74d406fdb0 2024-04-06T03:34:03.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.893+0000 7f74e1ffb700 1 -- 172.21.15.102:0/2225157345 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7f74e406a440 con 0x7f74d406fdb0 2024-04-06T03:34:03.895 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled node-exporter update... 2024-04-06T03:34:03.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 >> v2:172.21.15.47:6800/850698093 conn(0x7f74d406fdb0 msgr2=0x7f74d4072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:03.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 --2- 172.21.15.102:0/2225157345 >> v2:172.21.15.47:6800/850698093 conn(0x7f74d406fdb0 0x7f74d4072270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74e4102260 tx=0x7f74d8007400 comp rx=0 tx=0).stop 2024-04-06T03:34:03.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102400 msgr2=0x7f74e4197000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:03.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102400 0x7f74e4197000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74d000d950 tx=0x7f74d000dc60 comp rx=0 tx=0).stop 2024-04-06T03:34:03.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 shutdown_connections 2024-04-06T03:34:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 --2- 172.21.15.102:0/2225157345 >> v2:172.21.15.47:6800/850698093 conn(0x7f74d406fdb0 0x7f74d4072270 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74e4102da0 0x7f74e419e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101200 0x7f74e4196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 --2- 172.21.15.102:0/2225157345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e4102400 0x7f74e4197000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 >> 172.21.15.102:0/2225157345 conn(0x7f74e40fc7a0 msgr2=0x7f74e4105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 shutdown_connections 2024-04-06T03:34:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:03.895+0000 7f74eb196700 1 -- 172.21.15.102:0/2225157345 wait complete. 2024-04-06T03:34:03.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:03 smithi047 ceph-mon[29365]: mgrmap e16: y(active, since 4m), standbys: x 2024-04-06T03:34:03.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:03 smithi047 ceph-mon[37680]: mgrmap e16: y(active, since 4m), standbys: x 2024-04-06T03:34:05.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:04 smithi102 ceph-mon[32821]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi047=a;smithi102=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:05.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:04 smithi102 ceph-mon[32821]: Saving service node-exporter spec with placement smithi047=a;smithi102=b;count:2 2024-04-06T03:34:05.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:04 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:05.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:04 smithi102 ceph-mon[32821]: pgmap v204: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 4.4 KiB/s wr, 204 op/s 2024-04-06T03:34:05.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:04 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:05.127 DEBUG:teuthology.orchestra.run.smithi047:node-exporter.a> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@node-exporter.a.service 2024-04-06T03:34:05.130 DEBUG:teuthology.orchestra.run.smithi102:node-exporter.b> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@node-exporter.b.service 2024-04-06T03:34:05.132 INFO:tasks.cephadm:Adding alertmanager.a on smithi047 2024-04-06T03:34:05.132 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch apply alertmanager '1;smithi047=a' 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[29365]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi047=a;smithi102=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[29365]: Saving service node-exporter spec with placement smithi047=a;smithi102=b;count:2 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[29365]: pgmap v204: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 4.4 KiB/s wr, 204 op/s 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[37680]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi047=a;smithi102=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[37680]: Saving service node-exporter spec with placement smithi047=a;smithi102=b;count:2 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:05.156 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[37680]: pgmap v204: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 4.4 KiB/s wr, 204 op/s 2024-04-06T03:34:05.157 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:04 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:06.057 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:34:07.283 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.283 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.283 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:34:07.283 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:34:07.283 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:06 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.283 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:06 smithi102 ceph-mon[32821]: Deploying daemon prometheus.a on smithi102 2024-04-06T03:34:07.283 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:06 smithi102 ceph-mon[32821]: pgmap v205: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 4.0 KiB/s wr, 183 op/s 2024-04-06T03:34:07.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:34:07.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:34:07.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[29365]: Deploying daemon prometheus.a on smithi102 2024-04-06T03:34:07.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[29365]: pgmap v205: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 4.0 KiB/s wr, 183 op/s 2024-04-06T03:34:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:34:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:34:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[37680]: Deploying daemon prometheus.a on smithi102 2024-04-06T03:34:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:06 smithi047 ceph-mon[37680]: pgmap v205: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 4.0 KiB/s wr, 183 op/s 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 -- 172.21.15.102:0/3270849183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 msgr2=0x7efd28102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 --2- 172.21.15.102:0/3270849183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 0x7efd28102b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009990 tx=0x7efd1c009ca0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 -- 172.21.15.102:0/3270849183 shutdown_connections 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 --2- 172.21.15.102:0/3270849183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd28101e40 0x7efd28109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 --2- 172.21.15.102:0/3270849183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 0x7efd28102b80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 --2- 172.21.15.102:0/3270849183 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd281014a0 0x7efd28101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 -- 172.21.15.102:0/3270849183 >> 172.21.15.102:0/3270849183 conn(0x7efd280fbf10 msgr2=0x7efd280fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 -- 172.21.15.102:0/3270849183 shutdown_connections 2024-04-06T03:34:07.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 -- 172.21.15.102:0/3270849183 wait complete. 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 Processor -- start 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.632+0000 7efd2e909700 1 -- start start 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2e909700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd281014a0 0x7efd281051d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2e909700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd28101e40 0x7efd28103890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2e909700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 0x7efd28103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2e909700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efd2810c4e0 con 0x7efd28101e40 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2e909700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd2810c360 con 0x7efd28102760 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2e909700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7efd2810c660 con 0x7efd281014a0 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 0x7efd28103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 0x7efd28103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60030/0 (socket says 172.21.15.102:60030) 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 -- 172.21.15.102:0/3757355321 learned_addr learned my addr 172.21.15.102:0/3757355321 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd277fe700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd28101e40 0x7efd28103890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:07.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd27fff700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd281014a0 0x7efd281051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:07.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 -- 172.21.15.102:0/3757355321 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd281014a0 msgr2=0x7efd281051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:07.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd281014a0 0x7efd281051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 -- 172.21.15.102:0/3757355321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd28101e40 msgr2=0x7efd28103890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:07.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd28101e40 0x7efd28103890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 -- 172.21.15.102:0/3757355321 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd28104610 con 0x7efd28102760 2024-04-06T03:34:07.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.633+0000 7efd2cea6700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 0x7efd28103dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd20007ee0 tx=0x7efd2000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.634+0000 7efd257fa700 1 -- 172.21.15.102:0/3757355321 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2000ddd0 con 0x7efd28102760 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.634+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd281a1d60 con 0x7efd28102760 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.634+0000 7efd257fa700 1 -- 172.21.15.102:0/3757355321 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7efd20004020 con 0x7efd28102760 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.634+0000 7efd257fa700 1 -- 172.21.15.102:0/3757355321 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20015660 con 0x7efd28102760 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.634+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd281a2240 con 0x7efd28102760 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.635+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd28068f90 con 0x7efd28102760 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.635+0000 7efd257fa700 1 -- 172.21.15.102:0/3757355321 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 91788+0+0 (secure 0 0 0) 0x7efd20003a00 con 0x7efd28102760 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.636+0000 7efd257fa700 1 --2- 172.21.15.102:0/3757355321 >> v2:172.21.15.47:6800/850698093 conn(0x7efd1006dba0 0x7efd10070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:07.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.636+0000 7efd257fa700 1 -- 172.21.15.102:0/3757355321 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5942+0+0 (secure 0 0 0) 0x7efd2008d560 con 0x7efd28102760 2024-04-06T03:34:07.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.636+0000 7efd27fff700 1 --2- 172.21.15.102:0/3757355321 >> v2:172.21.15.47:6800/850698093 conn(0x7efd1006dba0 0x7efd10070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:07.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.637+0000 7efd27fff700 1 --2- 172.21.15.102:0/3757355321 >> v2:172.21.15.47:6800/850698093 conn(0x7efd1006dba0 0x7efd10070060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0038b0 tx=0x7efd1c003840 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:07.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.644+0000 7efd257fa700 1 -- 172.21.15.102:0/3757355321 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7efd20010070 con 0x7efd28102760 2024-04-06T03:34:07.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.866+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}) -- 0x7efd280fe0d0 con 0x7efd1006dba0 2024-04-06T03:34:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.873+0000 7efd257fa700 1 -- 172.21.15.102:0/3757355321 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7efd280fe0d0 con 0x7efd1006dba0 2024-04-06T03:34:07.874 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled alertmanager update... 2024-04-06T03:34:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 >> v2:172.21.15.47:6800/850698093 conn(0x7efd1006dba0 msgr2=0x7efd10070060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 --2- 172.21.15.102:0/3757355321 >> v2:172.21.15.47:6800/850698093 conn(0x7efd1006dba0 0x7efd10070060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0038b0 tx=0x7efd1c003840 comp rx=0 tx=0).stop 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 msgr2=0x7efd28103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 0x7efd28103dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd20007ee0 tx=0x7efd2000d3b0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 shutdown_connections 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 --2- 172.21.15.102:0/3757355321 >> v2:172.21.15.47:6800/850698093 conn(0x7efd1006dba0 0x7efd10070060 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd28102760 0x7efd28103dd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd281014a0 0x7efd281051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 --2- 172.21.15.102:0/3757355321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd28101e40 0x7efd28103890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 >> 172.21.15.102:0/3757355321 conn(0x7efd280fbf10 msgr2=0x7efd280fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 shutdown_connections 2024-04-06T03:34:07.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:07.875+0000 7efd2e909700 1 -- 172.21.15.102:0/3757355321 wait complete. 2024-04-06T03:34:08.686 DEBUG:teuthology.orchestra.run.smithi047:alertmanager.a> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@alertmanager.a.service 2024-04-06T03:34:08.689 INFO:tasks.cephadm:Adding grafana.a on smithi102 2024-04-06T03:34:08.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph orch apply grafana '1;smithi102=a' 2024-04-06T03:34:08.939 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:34:08.968 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:08 smithi102 ceph-mon[32821]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:08.968 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:08 smithi102 ceph-mon[32821]: Saving service alertmanager spec with placement smithi047=a;count:1 2024-04-06T03:34:08.968 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:08 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:08.968 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:08 smithi102 ceph-mon[32821]: pgmap v206: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 3.5 KiB/s wr, 160 op/s 2024-04-06T03:34:08.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:08 smithi047 ceph-mon[37680]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:08.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:08 smithi047 ceph-mon[37680]: Saving service alertmanager spec with placement smithi047=a;count:1 2024-04-06T03:34:08.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:08 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:08.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:08 smithi047 ceph-mon[37680]: pgmap v206: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 3.5 KiB/s wr, 160 op/s 2024-04-06T03:34:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:08 smithi047 ceph-mon[29365]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:08 smithi047 ceph-mon[29365]: Saving service alertmanager spec with placement smithi047=a;count:1 2024-04-06T03:34:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:08 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:08.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:08 smithi047 ceph-mon[29365]: pgmap v206: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 3.5 KiB/s wr, 160 op/s 2024-04-06T03:34:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:10 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:10 smithi102 ceph-mon[32821]: pgmap v207: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 3.5 KiB/s wr, 160 op/s 2024-04-06T03:34:10.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:10 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:10.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:10 smithi047 ceph-mon[29365]: pgmap v207: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 3.5 KiB/s wr, 160 op/s 2024-04-06T03:34:10.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:10 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:10.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:10 smithi047 ceph-mon[37680]: pgmap v207: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 3.5 KiB/s wr, 160 op/s 2024-04-06T03:34:11.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 -- 172.21.15.102:0/379431983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac1035f0 msgr2=0x7f31ac103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:11.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/379431983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac1035f0 0x7f31ac103a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009990 tx=0x7f31a0009ca0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 -- 172.21.15.102:0/379431983 shutdown_connections 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/379431983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ac103f90 0x7f31ac10a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/379431983 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31ac100610 0x7f31ac100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/379431983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac1035f0 0x7f31ac103a50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 -- 172.21.15.102:0/379431983 >> 172.21.15.102:0/379431983 conn(0x7f31ac0fbf70 msgr2=0x7f31ac0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 -- 172.21.15.102:0/379431983 shutdown_connections 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 -- 172.21.15.102:0/379431983 wait complete. 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.279+0000 7f31b1ddb700 1 Processor -- start 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31b1ddb700 1 -- start start 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31b1ddb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ac100610 0x7f31ac197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31b1ddb700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31ac1035f0 0x7f31ac1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31b1ddb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac103f90 0x7f31ac19f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31b1ddb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac10d6b0 con 0x7f31ac100610 2024-04-06T03:34:11.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31b1ddb700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac10d530 con 0x7f31ac103f90 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31b1ddb700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f31ac10d830 con 0x7f31ac1035f0 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31abfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac103f90 0x7f31ac19f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31abfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac103f90 0x7f31ac19f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60046/0 (socket says 172.21.15.102:60046) 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31abfff700 1 -- 172.21.15.102:0/4172445163 learned_addr learned my addr 172.21.15.102:0/4172445163 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31aaffd700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31ac1035f0 0x7f31ac1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31ab7fe700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ac100610 0x7f31ac197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31abfff700 1 -- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31ac1035f0 msgr2=0x7f31ac1980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31abfff700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31ac1035f0 0x7f31ac1980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31abfff700 1 -- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ac100610 msgr2=0x7f31ac197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31abfff700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ac100610 0x7f31ac197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31abfff700 1 -- 172.21.15.102:0/4172445163 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac19f800 con 0x7f31ac103f90 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.280+0000 7f31ab7fe700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ac100610 0x7f31ac197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.281+0000 7f31abfff700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac103f90 0x7f31ac19f160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31a4007d70 tx=0x7f31a400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.281+0000 7f31a8ff9700 1 -- 172.21.15.102:0/4172445163 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4016020 con 0x7f31ac103f90 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.281+0000 7f31a8ff9700 1 -- 172.21.15.102:0/4172445163 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f31a400ad40 con 0x7f31ac103f90 2024-04-06T03:34:11.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.281+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ac19faf0 con 0x7f31ac103f90 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.281+0000 7f31a8ff9700 1 -- 172.21.15.102:0/4172445163 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a40115e0 con 0x7f31ac103f90 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.281+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ac19ffe0 con 0x7f31ac103f90 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.282+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ac068f90 con 0x7f31ac103f90 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.282+0000 7f31a8ff9700 1 -- 172.21.15.102:0/4172445163 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 91788+0+0 (secure 0 0 0) 0x7f31a4019020 con 0x7f31ac103f90 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.283+0000 7f31a8ff9700 1 --2- 172.21.15.102:0/4172445163 >> v2:172.21.15.47:6800/850698093 conn(0x7f319406dba0 0x7f3194070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.283+0000 7f31a8ff9700 1 -- 172.21.15.102:0/4172445163 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5942+0+0 (secure 0 0 0) 0x7f31a408d890 con 0x7f31ac103f90 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.283+0000 7f31ab7fe700 1 --2- 172.21.15.102:0/4172445163 >> v2:172.21.15.47:6800/850698093 conn(0x7f319406dba0 0x7f3194070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.283+0000 7f31ab7fe700 1 --2- 172.21.15.102:0/4172445163 >> v2:172.21.15.47:6800/850698093 conn(0x7f319406dba0 0x7f3194070060 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f319c005950 tx=0x7f319c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:11.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.288+0000 7f31a8ff9700 1 -- 172.21.15.102:0/4172445163 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f31a4020020 con 0x7f31ac103f90 2024-04-06T03:34:11.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.496+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 --> v2:172.21.15.47:6800/850698093 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi102=a", "target": ["mon-mgr", ""]}) -- 0x7f31ac062710 con 0x7f319406dba0 2024-04-06T03:34:11.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.504+0000 7f31a8ff9700 1 -- 172.21.15.102:0/4172445163 <== mgr.14152 v2:172.21.15.47:6800/850698093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f31ac062710 con 0x7f319406dba0 2024-04-06T03:34:11.505 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled grafana update... 2024-04-06T03:34:11.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 >> v2:172.21.15.47:6800/850698093 conn(0x7f319406dba0 msgr2=0x7f3194070060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:11.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/4172445163 >> v2:172.21.15.47:6800/850698093 conn(0x7f319406dba0 0x7f3194070060 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f319c005950 tx=0x7f319c0058e0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac103f90 msgr2=0x7f31ac19f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:11.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac103f90 0x7f31ac19f160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31a4007d70 tx=0x7f31a400a340 comp rx=0 tx=0).stop 2024-04-06T03:34:11.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 shutdown_connections 2024-04-06T03:34:11.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/4172445163 >> v2:172.21.15.47:6800/850698093 conn(0x7f319406dba0 0x7f3194070060 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac103f90 0x7f31ac19f160 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ac100610 0x7f31ac197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 --2- 172.21.15.102:0/4172445163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31ac1035f0 0x7f31ac1980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:11.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.506+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 >> 172.21.15.102:0/4172445163 conn(0x7f31ac0fbf70 msgr2=0x7f31ac106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:11.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.507+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 shutdown_connections 2024-04-06T03:34:11.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:11.507+0000 7f31b1ddb700 1 -- 172.21.15.102:0/4172445163 wait complete. 2024-04-06T03:34:12.010 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:11 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:34:12.449 DEBUG:teuthology.orchestra.run.smithi102:grafana.a> sudo journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@grafana.a.service 2024-04-06T03:34:12.451 INFO:tasks.cephadm:Setting up client nodes... 2024-04-06T03:34:12.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-06T03:34:12.705 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[29365]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi102=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[29365]: Saving service grafana spec with placement smithi102=a;count:1 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[29365]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 706 B/s wr, 39 op/s 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[37680]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi102=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[37680]: Saving service grafana spec with placement smithi102=a;count:1 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:12.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:12 smithi047 ceph-mon[37680]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 706 B/s wr, 39 op/s 2024-04-06T03:34:12.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:12 smithi102 ceph-mon[32821]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi102=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T03:34:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:12 smithi102 ceph-mon[32821]: Saving service grafana spec with placement smithi102=a;count:1 2024-04-06T03:34:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:12 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:12 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:12 smithi102 ceph-mon[32821]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 706 B/s wr, 39 op/s 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 -- 172.21.15.47:0/2689970701 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 msgr2=0x7f3720103980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 --2- 172.21.15.47:0/2689970701 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 0x7f3720103980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3710009990 tx=0x7f3710009ca0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 -- 172.21.15.47:0/2689970701 shutdown_connections 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 --2- 172.21.15.47:0/2689970701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3720103ec0 0x7f372010a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 --2- 172.21.15.47:0/2689970701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3720102320 0x7f3720102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 --2- 172.21.15.47:0/2689970701 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 0x7f3720103980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 -- 172.21.15.47:0/2689970701 >> 172.21.15.47:0/2689970701 conn(0x7f37200fd8e0 msgr2=0x7f37200ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 -- 172.21.15.47:0/2689970701 shutdown_connections 2024-04-06T03:34:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 -- 172.21.15.47:0/2689970701 wait complete. 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 Processor -- start 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.424+0000 7f3727d02700 1 -- start start 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f3727d02700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3720102320 0x7f3720076070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f3727d02700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 0x7f37200746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f3727d02700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3720103ec0 0x7f3720074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f3727d02700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f372010d690 con 0x7f3720102320 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f3727d02700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f372010d510 con 0x7f3720103ec0 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f3727d02700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f372010d810 con 0x7f3720103520 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 0x7f37200746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 0x7f37200746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:37164/0 (socket says 172.21.15.47:37164) 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 -- 172.21.15.47:0/3206503514 learned_addr learned my addr 172.21.15.47:0/3206503514 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f3725a9e700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3720102320 0x7f3720076070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372629f700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3720103ec0 0x7f3720074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 -- 172.21.15.47:0/3206503514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3720103ec0 msgr2=0x7f3720074c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3720103ec0 0x7f3720074c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 -- 172.21.15.47:0/3206503514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3720102320 msgr2=0x7f3720076070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3720102320 0x7f3720076070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 -- 172.21.15.47:0/3206503514 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37200754b0 con 0x7f3720103520 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372629f700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3720103ec0 0x7f3720074c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f372529d700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 0x7f37200746c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3710006010 tx=0x7f37100047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.425+0000 7f3716ffd700 1 -- 172.21.15.47:0/3206503514 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710027070 con 0x7f3720103520 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.426+0000 7f3716ffd700 1 -- 172.21.15.47:0/3206503514 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f3710022470 con 0x7f3720103520 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.426+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37201a1ce0 con 0x7f3720103520 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.426+0000 7f3716ffd700 1 -- 172.21.15.47:0/3206503514 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710017650 con 0x7f3720103520 2024-04-06T03:34:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.426+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f37201a2130 con 0x7f3720103520 2024-04-06T03:34:14.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.427+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37200507e0 con 0x7f3720103520 2024-04-06T03:34:14.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.427+0000 7f3716ffd700 1 -- 172.21.15.47:0/3206503514 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 16) ==== 91788+0+0 (secure 0 0 0) 0x7f3710009d10 con 0x7f3720103520 2024-04-06T03:34:14.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.427+0000 7f3716ffd700 1 --2- 172.21.15.47:0/3206503514 >> v2:172.21.15.47:6800/850698093 conn(0x7f370c06dc40 0x7f370c070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:14.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.428+0000 7f3716ffd700 1 -- 172.21.15.47:0/3206503514 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(69..69 src has 1..69) ==== 5942+0+0 (secure 0 0 0) 0x7f371008e610 con 0x7f3720103520 2024-04-06T03:34:14.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.428+0000 7f3725a9e700 1 --2- 172.21.15.47:0/3206503514 >> v2:172.21.15.47:6800/850698093 conn(0x7f370c06dc40 0x7f370c070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:14.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.428+0000 7f3725a9e700 1 --2- 172.21.15.47:0/3206503514 >> v2:172.21.15.47:6800/850698093 conn(0x7f370c06dc40 0x7f370c070100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3720103380 tx=0x7f371c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:14.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.432+0000 7f3716ffd700 1 -- 172.21.15.47:0/3206503514 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3710013070 con 0x7f3720103520 2024-04-06T03:34:14.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.740+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f372002df50 con 0x7f3720103520 2024-04-06T03:34:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-04-06T03:34:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-04-06T03:34:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:14 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-04-06T03:34:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:14 smithi047 ceph-mon[29365]: pgmap v209: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 597 B/s wr, 33 op/s 2024-04-06T03:34:14.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:14 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-04-06T03:34:14.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:14 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-04-06T03:34:14.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:14 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-04-06T03:34:14.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:14 smithi047 ceph-mon[37680]: pgmap v209: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 597 B/s wr, 33 op/s 2024-04-06T03:34:14.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.744+0000 7f3716ffd700 1 -- 172.21.15.47:0/3206503514 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f371005c130 con 0x7f3720103520 2024-04-06T03:34:14.746 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-06T03:34:14.746 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC2whBmfyQ+LBAAut+shlsQ5LOMiEFZTcsRzw== 2024-04-06T03:34:14.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.746+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 >> v2:172.21.15.47:6800/850698093 conn(0x7f370c06dc40 msgr2=0x7f370c070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:14.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.746+0000 7f3727d02700 1 --2- 172.21.15.47:0/3206503514 >> v2:172.21.15.47:6800/850698093 conn(0x7f370c06dc40 0x7f370c070100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3720103380 tx=0x7f371c009260 comp rx=0 tx=0).stop 2024-04-06T03:34:14.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 msgr2=0x7f37200746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:14.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 0x7f37200746c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3710006010 tx=0x7f37100047b0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 shutdown_connections 2024-04-06T03:34:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 --2- 172.21.15.47:0/3206503514 >> v2:172.21.15.47:6800/850698093 conn(0x7f370c06dc40 0x7f370c070100 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3720103ec0 0x7f3720074c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3720102320 0x7f3720076070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 --2- 172.21.15.47:0/3206503514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3720103520 0x7f37200746c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 >> 172.21.15.47:0/3206503514 conn(0x7f37200fd8e0 msgr2=0x7f37201067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 shutdown_connections 2024-04-06T03:34:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:14.747+0000 7f3727d02700 1 -- 172.21.15.47:0/3206503514 wait complete. 2024-04-06T03:34:14.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:14 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-04-06T03:34:14.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:14 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-04-06T03:34:14.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:14 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-04-06T03:34:14.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:14 smithi102 ceph-mon[32821]: pgmap v209: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 597 B/s wr, 33 op/s 2024-04-06T03:34:15.418 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:34:15.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-06T03:34:15.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-06T03:34:15.463 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-06T03:34:15.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-04-06T03:34:15.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-04-06T03:34:15.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-04-06T03:34:15.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[29365]: osdmap e70: 8 total, 8 up, 8 in 2024-04-06T03:34:15.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3206503514' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:15.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:15.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T03:34:15.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[29365]: osdmap e71: 8 total, 8 up, 8 in 2024-04-06T03:34:15.697 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-04-06T03:34:15.697 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-04-06T03:34:15.697 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-04-06T03:34:15.697 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[37680]: osdmap e70: 8 total, 8 up, 8 in 2024-04-06T03:34:15.697 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3206503514' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:15.697 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:15.697 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T03:34:15.697 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:15 smithi047 ceph-mon[37680]: osdmap e71: 8 total, 8 up, 8 in 2024-04-06T03:34:15.702 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.b/config 2024-04-06T03:34:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:15 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-04-06T03:34:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:15 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-04-06T03:34:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:15 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-04-06T03:34:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:15 smithi102 ceph-mon[32821]: osdmap e70: 8 total, 8 up, 8 in 2024-04-06T03:34:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3206503514' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T03:34:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:15 smithi102 ceph-mon[32821]: osdmap e71: 8 total, 8 up, 8 in 2024-04-06T03:34:16.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:16 smithi102 ceph-mon[32821]: pgmap v212: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 13 B/s, 0 objects/s recovering 2024-04-06T03:34:16.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:16 smithi047 ceph-mon[37680]: pgmap v212: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 13 B/s, 0 objects/s recovering 2024-04-06T03:34:16.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:16 smithi047 ceph-mon[29365]: pgmap v212: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 13 B/s, 0 objects/s recovering 2024-04-06T03:34:18.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:18 smithi102 ceph-mon[32821]: pgmap v213: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:18.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:18 smithi047 ceph-mon[29365]: pgmap v213: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:18.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:18 smithi047 ceph-mon[37680]: pgmap v213: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:20 smithi102 ceph-mon[32821]: pgmap v214: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:20.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 -- 172.21.15.102:0/1815142907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 msgr2=0x7efcbc1096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:20.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1815142907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 0x7efcbc1096f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efcb400b0d0 tx=0x7efcb400b3e0 comp rx=0 tx=0).stop 2024-04-06T03:34:20.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 -- 172.21.15.102:0/1815142907 shutdown_connections 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1815142907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 0x7efcbc1096f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1815142907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcbc1012a0 0x7efcbc1016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1815142907 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efcbc1024a0 0x7efcbc102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 -- 172.21.15.102:0/1815142907 >> 172.21.15.102:0/1815142907 conn(0x7efcbc0fc860 msgr2=0x7efcbc0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 -- 172.21.15.102:0/1815142907 shutdown_connections 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.763+0000 7efcc35e7700 1 -- 172.21.15.102:0/1815142907 wait complete. 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc35e7700 1 Processor -- start 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc35e7700 1 -- start start 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc35e7700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efcbc1012a0 0x7efcbc196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc35e7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcbc1024a0 0x7efcbc196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc35e7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 0x7efcbc19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc35e7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc10c5b0 con 0x7efcbc1024a0 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc35e7700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc10c430 con 0x7efcbc102e40 2024-04-06T03:34:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc35e7700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7efcbc10c730 con 0x7efcbc1012a0 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1b84700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 0x7efcbc19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1b84700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 0x7efcbc19e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33724/0 (socket says 172.21.15.102:33724) 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1b84700 1 -- 172.21.15.102:0/1684758857 learned_addr learned my addr 172.21.15.102:0/1684758857 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1383700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efcbc1012a0 0x7efcbc196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc0b82700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcbc1024a0 0x7efcbc196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1b84700 1 -- 172.21.15.102:0/1684758857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efcbc1012a0 msgr2=0x7efcbc196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1b84700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efcbc1012a0 0x7efcbc196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1b84700 1 -- 172.21.15.102:0/1684758857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcbc1024a0 msgr2=0x7efcbc196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1b84700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcbc1024a0 0x7efcbc196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.764+0000 7efcc1b84700 1 -- 172.21.15.102:0/1684758857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcbc19e6a0 con 0x7efcbc102e40 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.765+0000 7efcc1b84700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 0x7efcbc19e000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009fd0 tx=0x7efcb4007ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.765+0000 7efcb27fc700 1 -- 172.21.15.102:0/1684758857 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb401f020 con 0x7efcbc102e40 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.765+0000 7efcb27fc700 1 -- 172.21.15.102:0/1684758857 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7efcb4003e10 con 0x7efcbc102e40 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.765+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcbc19e930 con 0x7efcbc102e40 2024-04-06T03:34:20.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.765+0000 7efcb27fc700 1 -- 172.21.15.102:0/1684758857 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb401b7d0 con 0x7efcbc102e40 2024-04-06T03:34:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.765+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcbc19ed80 con 0x7efcbc102e40 2024-04-06T03:34:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.766+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcbc0507e0 con 0x7efcbc102e40 2024-04-06T03:34:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.766+0000 7efcb27fc700 1 -- 172.21.15.102:0/1684758857 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 91788+0+0 (secure 0 0 0) 0x7efcb4022020 con 0x7efcbc102e40 2024-04-06T03:34:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.766+0000 7efcb27fc700 1 --2- 172.21.15.102:0/1684758857 >> v2:172.21.15.47:6800/850698093 conn(0x7efca806dc40 0x7efca8070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.767+0000 7efcb27fc700 1 -- 172.21.15.102:0/1684758857 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6001+0+0 (secure 0 0 0) 0x7efcb400f020 con 0x7efcbc102e40 2024-04-06T03:34:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.767+0000 7efcc1383700 1 --2- 172.21.15.102:0/1684758857 >> v2:172.21.15.47:6800/850698093 conn(0x7efca806dc40 0x7efca8070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.767+0000 7efcc1383700 1 --2- 172.21.15.102:0/1684758857 >> v2:172.21.15.47:6800/850698093 conn(0x7efca806dc40 0x7efca8070100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efcbc102300 tx=0x7efcac00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:20.771+0000 7efcb27fc700 1 -- 172.21.15.102:0/1684758857 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7efcb405c490 con 0x7efcbc102e40 2024-04-06T03:34:20.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:20 smithi047 ceph-mon[29365]: pgmap v214: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:20.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:20 smithi047 ceph-mon[37680]: pgmap v214: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:21.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.058+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7efcbc02db70 con 0x7efcbc102e40 2024-04-06T03:34:21.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.063+0000 7efcb27fc700 1 -- 172.21.15.102:0/1684758857 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7efcb405bd90 con 0x7efcbc102e40 2024-04-06T03:34:21.064 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2024-04-06T03:34:21.064 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC9whBm6TOUAxAA+HHU/gwGdm6KQgtefGAeOQ== 2024-04-06T03:34:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 >> v2:172.21.15.47:6800/850698093 conn(0x7efca806dc40 msgr2=0x7efca8070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1684758857 >> v2:172.21.15.47:6800/850698093 conn(0x7efca806dc40 0x7efca8070100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efcbc102300 tx=0x7efcac00a380 comp rx=0 tx=0).stop 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 msgr2=0x7efcbc19e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 0x7efcbc19e000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009fd0 tx=0x7efcb4007ca0 comp rx=0 tx=0).stop 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 shutdown_connections 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1684758857 >> v2:172.21.15.47:6800/850698093 conn(0x7efca806dc40 0x7efca8070100 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcbc102e40 0x7efcbc19e000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efcbc1012a0 0x7efcbc196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 --2- 172.21.15.102:0/1684758857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcbc1024a0 0x7efcbc196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 >> 172.21.15.102:0/1684758857 conn(0x7efcbc0fc860 msgr2=0x7efcbc1056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.065+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 shutdown_connections 2024-04-06T03:34:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-06T03:34:21.066+0000 7efcc35e7700 1 -- 172.21.15.102:0/1684758857 wait complete. 2024-04-06T03:34:21.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:34:21.724 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.102:0/1684758857' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:21.724 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:21.724 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T03:34:21.725 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-06T03:34:21.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-06T03:34:21.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-06T03:34:21.768 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-06T03:34:21.768 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-06T03:34:21.768 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph mgr dump --format=json 2024-04-06T03:34:21.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.102:0/1684758857' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:21.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:21.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T03:34:21.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.102:0/1684758857' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:21.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T03:34:21.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T03:34:22.026 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:22.084 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:34:21 smithi102 systemd[1]: Started Ceph prometheus.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:34:23.174 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ignoring --setuser ceph since I am not root 2024-04-06T03:34:23.174 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ignoring --setgroup ceph since I am not root 2024-04-06T03:34:23.174 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:23.174 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.174 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.174 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.174 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-06T03:34:23.174 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[29365]: pgmap v215: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:23.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:23.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-06T03:34:23.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:22 smithi047 ceph-mon[37680]: pgmap v215: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:23.334 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: ignoring --setuser ceph since I am not root 2024-04-06T03:34:23.334 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: ignoring --setgroup ceph since I am not root 2024-04-06T03:34:23.334 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:23 smithi102 ceph-mgr[34674]: -- 172.21.15.102:0/261237082 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d8508205a0 con 0x55d8507f5000 2024-04-06T03:34:23.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:22 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:23.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:22 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:22 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:22 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' 2024-04-06T03:34:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:22 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-06T03:34:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:22 smithi102 ceph-mon[32821]: pgmap v215: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-04-06T03:34:23.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 -- 172.21.15.47:0/1953770933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a741025b0 msgr2=0x7f0a74102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:23.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 --2- 172.21.15.47:0/1953770933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a741025b0 0x7f0a74102990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009990 tx=0x7f0a70009ca0 comp rx=0 tx=0).stop 2024-04-06T03:34:23.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 -- 172.21.15.47:0/1953770933 shutdown_connections 2024-04-06T03:34:23.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 --2- 172.21.15.47:0/1953770933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a741075e0 0x7f0a7410f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:23.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 --2- 172.21.15.47:0/1953770933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a741025b0 0x7f0a74102990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:23.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 --2- 172.21.15.47:0/1953770933 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0a74102f60 0x7f0a74106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:23.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 -- 172.21.15.47:0/1953770933 >> 172.21.15.47:0/1953770933 conn(0x7f0a74079360 msgr2=0x7f0a74079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:23.733 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:23.616+0000 7f71cbf49200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-06T03:34:23.733 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:23.716+0000 7f71cbf49200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-06T03:34:23.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 -- 172.21.15.47:0/1953770933 shutdown_connections 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.731+0000 7f0a7c312700 1 -- 172.21.15.47:0/1953770933 wait complete. 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.732+0000 7f0a7c312700 1 Processor -- start 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.732+0000 7f0a7c312700 1 -- start start 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.732+0000 7f0a7c312700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a741025b0 0x7f0a74198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.732+0000 7f0a7c312700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a74102f60 0x7f0a741987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.732+0000 7f0a7c312700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0a741075e0 0x7f0a7419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.732+0000 7f0a7c312700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74111cb0 con 0x7f0a74102f60 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.732+0000 7f0a7c312700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74111b30 con 0x7f0a741025b0 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.732+0000 7f0a7c312700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f0a74111e30 con 0x7f0a741075e0 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a0ae700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a741025b0 0x7f0a74198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a8af700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0a741075e0 0x7f0a7419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a8af700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0a741075e0 0x7f0a7419caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:38292/0 (socket says 172.21.15.47:38292) 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a8af700 1 -- 172.21.15.47:0/124424584 learned_addr learned my addr 172.21.15.47:0/124424584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a0ae700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a741025b0 0x7f0a74198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.47:49618/0 (socket says 172.21.15.47:49618) 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a798ad700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a74102f60 0x7f0a741987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a0ae700 1 -- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0a741075e0 msgr2=0x7f0a7419caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a0ae700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0a741075e0 0x7f0a7419caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a0ae700 1 -- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a74102f60 msgr2=0x7f0a741987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a0ae700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a74102f60 0x7f0a741987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a0ae700 1 -- 172.21.15.47:0/124424584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7419d230 con 0x7f0a741025b0 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a798ad700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a74102f60 0x7f0a741987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a8af700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0a741075e0 0x7f0a7419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.733+0000 7f0a7a0ae700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a741025b0 0x7f0a74198270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a70000c00 tx=0x7f0a70005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.734+0000 7f0a6b7fe700 1 -- 172.21.15.47:0/124424584 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000f900 con 0x7f0a741025b0 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.734+0000 7f0a6b7fe700 1 -- 172.21.15.47:0/124424584 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f0a70005030 con 0x7f0a741025b0 2024-04-06T03:34:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.734+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7419d4c0 con 0x7f0a741025b0 2024-04-06T03:34:23.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.734+0000 7f0a6b7fe700 1 -- 172.21.15.47:0/124424584 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70004b50 con 0x7f0a741025b0 2024-04-06T03:34:23.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.734+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a741a4da0 con 0x7f0a741025b0 2024-04-06T03:34:23.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.735+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a741039e0 con 0x7f0a741025b0 2024-04-06T03:34:23.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.735+0000 7f0a6b7fe700 1 -- 172.21.15.47:0/124424584 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 17) ==== 91802+0+0 (secure 0 0 0) 0x7f0a70009d10 con 0x7f0a741025b0 2024-04-06T03:34:23.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.736+0000 7f0a6b7fe700 1 --2- 172.21.15.47:0/124424584 >> v2:172.21.15.47:6800/850698093 conn(0x7f0a6006dbf0 0x7f0a600700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:23.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.736+0000 7f0a798ad700 1 -- 172.21.15.47:0/124424584 >> v2:172.21.15.47:6800/850698093 conn(0x7f0a6006dbf0 msgr2=0x7f0a600700b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/850698093 2024-04-06T03:34:23.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.736+0000 7f0a6b7fe700 1 -- 172.21.15.47:0/124424584 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6001+0+0 (secure 0 0 0) 0x7f0a7008e830 con 0x7f0a741025b0 2024-04-06T03:34:23.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.736+0000 7f0a798ad700 1 --2- 172.21.15.47:0/124424584 >> v2:172.21.15.47:6800/850698093 conn(0x7f0a6006dbf0 0x7f0a600700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:34:23.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.744+0000 7f0a6b7fe700 1 -- 172.21.15.47:0/124424584 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0a70013070 con 0x7f0a741025b0 2024-04-06T03:34:23.834 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:23.580+0000 7f8f52523200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-06T03:34:23.834 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:23.672+0000 7f8f52523200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-06T03:34:23.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.937+0000 7f0a798ad700 1 -- 172.21.15.47:0/124424584 >> v2:172.21.15.47:6800/850698093 conn(0x7f0a6006dbf0 msgr2=0x7f0a600700b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/850698093 2024-04-06T03:34:23.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:23.937+0000 7f0a798ad700 1 --2- 172.21.15.47:0/124424584 >> v2:172.21.15.47:6800/850698093 conn(0x7f0a6006dbf0 0x7f0a600700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-06T03:34:24.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.007+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0a74199580 con 0x7f0a741025b0 2024-04-06T03:34:24.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.012+0000 7f0a6b7fe700 1 -- 172.21.15.47:0/124424584 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+175391 (secure 0 0 0) 0x7f0a7005c330 con 0x7f0a741025b0 2024-04-06T03:34:24.017 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:34:24.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 >> v2:172.21.15.47:6800/850698093 conn(0x7f0a6006dbf0 msgr2=0x7f0a600700b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:34:24.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 --2- 172.21.15.47:0/124424584 >> v2:172.21.15.47:6800/850698093 conn(0x7f0a6006dbf0 0x7f0a600700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:24.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a741025b0 msgr2=0x7f0a74198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:24.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a741025b0 0x7f0a74198270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a70000c00 tx=0x7f0a70005f10 comp rx=0 tx=0).stop 2024-04-06T03:34:24.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 shutdown_connections 2024-04-06T03:34:24.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 --2- 172.21.15.47:0/124424584 >> v2:172.21.15.47:6800/850698093 conn(0x7f0a6006dbf0 0x7f0a600700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:24.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0a741075e0 0x7f0a7419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:24.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a741025b0 0x7f0a74198270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:24.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 --2- 172.21.15.47:0/124424584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a74102f60 0x7f0a741987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:24.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 >> 172.21.15.47:0/124424584 conn(0x7f0a74079360 msgr2=0x7f0a741001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:24.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 shutdown_connections 2024-04-06T03:34:24.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:24.015+0000 7f0a7c312700 1 -- 172.21.15.47:0/124424584 wait complete. 2024-04-06T03:34:24.311 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-mon[32821]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-06T03:34:24.311 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-mon[32821]: mgrmap e17: y(active, since 5m), standbys: x 2024-04-06T03:34:24.311 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/124424584' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-06T03:34:24.352 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-mon[29365]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-06T03:34:24.353 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-mon[29365]: mgrmap e17: y(active, since 5m), standbys: x 2024-04-06T03:34:24.353 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/124424584' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-06T03:34:24.353 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-mon[37680]: from='mgr.14152 172.21.15.47:0/2435765682' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-06T03:34:24.353 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-mon[37680]: mgrmap e17: y(active, since 5m), standbys: x 2024-04-06T03:34:24.353 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/124424584' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-06T03:34:24.584 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:24.309+0000 7f8f52523200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-06T03:34:24.584 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:24.400+0000 7f8f52523200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-06T03:34:24.584 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:24.540+0000 7f8f52523200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-06T03:34:24.633 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:24.391+0000 7f71cbf49200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-06T03:34:24.633 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:24.487+0000 7f71cbf49200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-06T03:34:24.633 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:24.631+0000 7f71cbf49200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-06T03:34:24.719 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":850698093}]},"active_addr":"172.21.15.47:6800/850698093","active_change":"2024-04-06T03:29:14.432141+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.47:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"cephadm","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3904048976}]},{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":270434910}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2697704821}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":324217584}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3998151514}]}]} 2024-04-06T03:34:24.723 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-06T03:34:24.723 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-06T03:34:24.723 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-06T03:34:24.972 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:24.983 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:24.636+0000 7f8f52523200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-06T03:34:24.983 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:24.719+0000 7f8f52523200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-06T03:34:24.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:24.735+0000 7f71cbf49200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-06T03:34:24.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:24 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:24.824+0000 7f71cbf49200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-06T03:34:25.273 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:24.981+0000 7f8f52523200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-06T03:34:25.273 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:25.091+0000 7f8f52523200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-06T03:34:25.273 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:25.176+0000 7f8f52523200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-06T03:34:25.273 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:25.271+0000 7f8f52523200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-06T03:34:25.418 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:25 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:25.112+0000 7f71cbf49200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-06T03:34:25.418 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:25 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:25.228+0000 7f71cbf49200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-06T03:34:25.418 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:25 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:25.317+0000 7f71cbf49200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-06T03:34:25.584 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:25.445+0000 7f8f52523200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-06T03:34:25.743 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:25 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:25.418+0000 7f71cbf49200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-06T03:34:25.743 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:25 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:25.598+0000 7f71cbf49200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 -- 172.21.15.47:0/1941017577 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384100e70 msgr2=0x7fb384101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 --2- 172.21.15.47:0/1941017577 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384100e70 0x7fb384101250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb3740099c0 tx=0x7fb374009cd0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 -- 172.21.15.47:0/1941017577 shutdown_connections 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 --2- 172.21.15.47:0/1941017577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb384107690 0x7fb38410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 --2- 172.21.15.47:0/1941017577 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384100e70 0x7fb384101250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 --2- 172.21.15.47:0/1941017577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb384101820 0x7fb384106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 -- 172.21.15.47:0/1941017577 >> 172.21.15.47:0/1941017577 conn(0x7fb384076530 msgr2=0x7fb384076940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 -- 172.21.15.47:0/1941017577 shutdown_connections 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.643+0000 7fb38a235700 1 -- 172.21.15.47:0/1941017577 wait complete. 2024-04-06T03:34:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.644+0000 7fb38a235700 1 Processor -- start 2024-04-06T03:34:26.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.644+0000 7fb38a235700 1 -- start start 2024-04-06T03:34:26.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.644+0000 7fb38a235700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb384100e70 0x7fb384198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.644+0000 7fb38a235700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384101820 0x7fb384198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb38a235700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb384107690 0x7fb38419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb38a235700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb384111d30 con 0x7fb384107690 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb38a235700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb384111bb0 con 0x7fb384100e70 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb38a235700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb384111eb0 con 0x7fb384101820 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb384107690 0x7fb38419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb382ffd700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384101820 0x7fb384198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb384107690 0x7fb38419cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48904/0 (socket says 172.21.15.47:48904) 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 -- 172.21.15.47:0/2360631061 learned_addr learned my addr 172.21.15.47:0/2360631061 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb3837fe700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb384100e70 0x7fb384198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 -- 172.21.15.47:0/2360631061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384101820 msgr2=0x7fb384198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384101820 0x7fb384198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 -- 172.21.15.47:0/2360631061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb384100e70 msgr2=0x7fb384198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb384100e70 0x7fb384198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 -- 172.21.15.47:0/2360631061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38419d260 con 0x7fb384107690 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb382ffd700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384101820 0x7fb384198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb383fff700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb384107690 0x7fb38419cb20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb37c007ee0 tx=0x7fb37c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb380ff9700 1 -- 172.21.15.47:0/2360631061 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c004bb0 con 0x7fb384107690 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38419d550 con 0x7fb384107690 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.645+0000 7fb380ff9700 1 -- 172.21.15.47:0/2360631061 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fb37c004d50 con 0x7fb384107690 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.646+0000 7fb380ff9700 1 -- 172.21.15.47:0/2360631061 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c005910 con 0x7fb384107690 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.646+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3841a4dd0 con 0x7fb384107690 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.647+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb384068f90 con 0x7fb384107690 2024-04-06T03:34:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.647+0000 7fb380ff9700 1 -- 172.21.15.47:0/2360631061 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 91802+0+0 (secure 0 0 0) 0x7fb37c01a020 con 0x7fb384107690 2024-04-06T03:34:26.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.647+0000 7fb380ff9700 1 --2- 172.21.15.47:0/2360631061 >> v2:172.21.15.47:6800/850698093 conn(0x7fb36c06dbf0 0x7fb36c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:26.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.647+0000 7fb3837fe700 1 -- 172.21.15.47:0/2360631061 >> v2:172.21.15.47:6800/850698093 conn(0x7fb36c06dbf0 msgr2=0x7fb36c0700b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/850698093 2024-04-06T03:34:26.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.648+0000 7fb380ff9700 1 -- 172.21.15.47:0/2360631061 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6001+0+0 (secure 0 0 0) 0x7fb37c08d0b0 con 0x7fb384107690 2024-04-06T03:34:26.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.648+0000 7fb3837fe700 1 --2- 172.21.15.47:0/2360631061 >> v2:172.21.15.47:6800/850698093 conn(0x7fb36c06dbf0 0x7fb36c0700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:34:26.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.652+0000 7fb380ff9700 1 -- 172.21.15.47:0/2360631061 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb37c010070 con 0x7fb384107690 2024-04-06T03:34:26.732 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:26 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:26.609+0000 7f71cbf49200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-06T03:34:26.762 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:26.399+0000 7f8f52523200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-06T03:34:26.762 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:26.533+0000 7f8f52523200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-06T03:34:26.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.849+0000 7fb3837fe700 1 -- 172.21.15.47:0/2360631061 >> v2:172.21.15.47:6800/850698093 conn(0x7fb36c06dbf0 msgr2=0x7fb36c0700b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/850698093 2024-04-06T03:34:26.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.849+0000 7fb3837fe700 1 --2- 172.21.15.47:0/2360631061 >> v2:172.21.15.47:6800/850698093 conn(0x7fb36c06dbf0 0x7fb36c0700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-06T03:34:26.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.862+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3841a5000 con 0x7fb384107690 2024-04-06T03:34:26.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.863+0000 7fb380ff9700 1 -- 172.21.15.47:0/2360631061 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+20673 (secure 0 0 0) 0x7fb37c05ab90 con 0x7fb384107690 2024-04-06T03:34:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:34:26.866 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":71,"fsid":"8f6329a8-f3c5-11ee-b649-cb9ed24678a4","created":"2024-04-06T03:28:10.981912+0000","modified":"2024-04-06T03:34:15.518293+0000","last_up_change":"2024-04-06T03:33:35.857014+0000","last_in_change":"2024-04-06T03:33:18.570369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-06T03:31:32.766604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2024-04-06T03:33:48.621993+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":64,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-04-06T03:33:49.051577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-04-06T03:33:51.005139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-04-06T03:33:52.955870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-04-06T03:33:55.013690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ec002d7-209e-4bd2-850f-4c843760e184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6801","nonce":1723574942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1723574942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1723574942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":1723574942}]},"public_addr":"172.21.15.47:6801/1723574942","cluster_addr":"172.21.15.47:6802/1723574942","heartbeat_back_addr":"172.21.15.47:6804/1723574942","heartbeat_front_addr":"172.21.15.47:6803/1723574942","state":["exists","up"]},{"osd":1,"uuid":"d9e6ac29-f4e4-4811-a9a7-d206e26183bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":1617120903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1617120903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1617120903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":1617120903}]},"public_addr":"172.21.15.47:6805/1617120903","cluster_addr":"172.21.15.47:6806/1617120903","heartbeat_back_addr":"172.21.15.47:6808/1617120903","heartbeat_front_addr":"172.21.15.47:6807/1617120903","state":["exists","up"]},{"osd":2,"uuid":"00d98fac-1ce6-4422-98e6-d1ad99cdfaf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1442630653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1442630653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1442630653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":1442630653}]},"public_addr":"172.21.15.47:6809/1442630653","cluster_addr":"172.21.15.47:6810/1442630653","heartbeat_back_addr":"172.21.15.47:6812/1442630653","heartbeat_front_addr":"172.21.15.47:6811/1442630653","state":["exists","up"]},{"osd":3,"uuid":"148e8f94-0638-4af1-9a5e-f8ec0ee2cf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":299519913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":299519913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":299519913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":299519913}]},"public_addr":"172.21.15.47:6813/299519913","cluster_addr":"172.21.15.47:6814/299519913","heartbeat_back_addr":"172.21.15.47:6816/299519913","heartbeat_front_addr":"172.21.15.47:6815/299519913","state":["exists","up"]},{"osd":4,"uuid":"ccfd48fd-61bd-46b4-b83a-c8396e41b3a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1031996030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6801","nonce":1031996030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6803","nonce":1031996030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1031996030}]},"public_addr":"172.21.15.102:6800/1031996030","cluster_addr":"172.21.15.102:6801/1031996030","heartbeat_back_addr":"172.21.15.102:6803/1031996030","heartbeat_front_addr":"172.21.15.102:6802/1031996030","state":["exists","up"]},{"osd":5,"uuid":"1411f970-4f9e-4e08-9222-905c8c91835e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":386919126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6805","nonce":386919126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6807","nonce":386919126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":386919126}]},"public_addr":"172.21.15.102:6804/386919126","cluster_addr":"172.21.15.102:6805/386919126","heartbeat_back_addr":"172.21.15.102:6807/386919126","heartbeat_front_addr":"172.21.15.102:6806/386919126","state":["exists","up"]},{"osd":6,"uuid":"1369f589-dc4c-4cd8-94c2-7e89b44fa548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":4105297178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":4105297178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":4105297178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4105297178}]},"public_addr":"172.21.15.102:6808/4105297178","cluster_addr":"172.21.15.102:6809/4105297178","heartbeat_back_addr":"172.21.15.102:6811/4105297178","heartbeat_front_addr":"172.21.15.102:6810/4105297178","state":["exists","up"]},{"osd":7,"uuid":"c782d6e2-04f7-462f-9f3e-ca539b5d8256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3557443636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3557443636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":3557443636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3557443636}]},"public_addr":"172.21.15.102:6812/3557443636","cluster_addr":"172.21.15.102:6813/3557443636","heartbeat_back_addr":"172.21.15.102:6815/3557443636","heartbeat_front_addr":"172.21.15.102:6814/3557443636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:30:38.617682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:03.457695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:29.382721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:55.764293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:32:19.310003+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:32:44.054598+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:33:08.591126+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:33:34.758478+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/2499466181":"2024-04-07T03:29:14.432037+0000","172.21.15.47:6800/4248661693":"2024-04-07T03:29:14.432037+0000","172.21.15.47:0/3946620428":"2024-04-07T03:29:14.432037+0000","172.21.15.47:0/1620211743":"2024-04-07T03:28:47.430977+0000","172.21.15.47:6800/2668596695":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/2300916716":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/1849130368":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/1343743305":"2024-04-07T03:29:14.432037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T03:34:26.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 >> v2:172.21.15.47:6800/850698093 conn(0x7fb36c06dbf0 msgr2=0x7fb36c0700b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 --2- 172.21.15.47:0/2360631061 >> v2:172.21.15.47:6800/850698093 conn(0x7fb36c06dbf0 0x7fb36c0700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb384107690 msgr2=0x7fb38419cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb384107690 0x7fb38419cb20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb37c007ee0 tx=0x7fb37c00d3b0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 shutdown_connections 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 --2- 172.21.15.47:0/2360631061 >> v2:172.21.15.47:6800/850698093 conn(0x7fb36c06dbf0 0x7fb36c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb384107690 0x7fb38419cb20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb384100e70 0x7fb384198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 --2- 172.21.15.47:0/2360631061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb384101820 0x7fb384198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 >> 172.21.15.47:0/2360631061 conn(0x7fb384076530 msgr2=0x7fb3840fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 shutdown_connections 2024-04-06T03:34:26.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:26.866+0000 7fb38a235700 1 -- 172.21.15.47:0/2360631061 wait complete. 2024-04-06T03:34:26.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2360631061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:34:26.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2360631061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:34:26.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:26 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:26.763+0000 7f71cbf49200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-06T03:34:27.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2360631061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:34:27.084 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:26.886+0000 7f8f52523200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-06T03:34:27.084 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:26.982+0000 7f8f52523200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-06T03:34:27.411 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:27 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:27.110+0000 7f71cbf49200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-06T03:34:27.411 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:27 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:27.205+0000 7f71cbf49200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-06T03:34:27.411 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:27 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:27.409+0000 7f71cbf49200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:34:27.584 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:27.189+0000 7f8f52523200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:34:27.584 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:27.379+0000 7f8f52523200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-06T03:34:27.634 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-06T03:34:27.634 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-06T03:34:27.662 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:27 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:27.601+0000 7f71cbf49200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-06T03:34:27.908 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:27.930 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:27.668+0000 7f8f52523200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:34:28.187 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:27 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:27.942+0000 7f71cbf49200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-06T03:34:28.334 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:27.928+0000 7f8f52523200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-06T03:34:28.334 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:28.165+0000 7f8f52523200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-06T03:34:28.478 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:28 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:28.220+0000 7f71cbf49200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-06T03:34:28.743 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:28 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:28.476+0000 7f71cbf49200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-06T03:34:29.334 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:28.970+0000 7f8f52523200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-06T03:34:29.423 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:29.335+0000 7f71cbf49200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-06T03:34:29.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.777+0000 7f5a663e3700 1 -- 172.21.15.47:0/327347311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 msgr2=0x7f5a6010e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:29.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.777+0000 7f5a663e3700 1 --2- 172.21.15.47:0/327347311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 0x7f5a6010e050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800b0a0 tx=0x7f5a5800b3b0 comp rx=0 tx=0).stop 2024-04-06T03:34:29.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.777+0000 7f5a663e3700 1 -- 172.21.15.47:0/327347311 shutdown_connections 2024-04-06T03:34:29.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.777+0000 7f5a663e3700 1 --2- 172.21.15.47:0/327347311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 0x7f5a6010e050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.777+0000 7f5a663e3700 1 --2- 172.21.15.47:0/327347311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a60107210 0x7f5a601075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.777+0000 7f5a663e3700 1 --2- 172.21.15.47:0/327347311 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a601011d0 0x7f5a60101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.777+0000 7f5a663e3700 1 -- 172.21.15.47:0/327347311 >> 172.21.15.47:0/327347311 conn(0x7f5a60078100 msgr2=0x7f5a60078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.777+0000 7f5a663e3700 1 -- 172.21.15.47:0/327347311 shutdown_connections 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.778+0000 7f5a663e3700 1 -- 172.21.15.47:0/327347311 wait complete. 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.778+0000 7f5a663e3700 1 Processor -- start 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.778+0000 7f5a663e3700 1 -- start start 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a663e3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a601011d0 0x7f5a60102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a663e3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 0x7f5a601033c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a663e3700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a60107210 0x7f5a60103900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a663e3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60110b60 con 0x7f5a60101b70 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a663e3700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601109e0 con 0x7f5a601011d0 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a663e3700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f5a60110ce0 con 0x7f5a60107210 2024-04-06T03:34:29.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a5f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 0x7f5a601033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:29.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a64980700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a60107210 0x7f5a60103900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:29.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a5f7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 0x7f5a601033c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48924/0 (socket says 172.21.15.47:48924) 2024-04-06T03:34:29.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a5f7fe700 1 -- 172.21.15.47:0/1234724840 learned_addr learned my addr 172.21.15.47:0/1234724840 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:29.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a5ffff700 1 --2- 172.21.15.47:0/1234724840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a601011d0 0x7f5a60102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:29.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a64980700 1 -- 172.21.15.47:0/1234724840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a601011d0 msgr2=0x7f5a60102e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:29.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a64980700 1 --2- 172.21.15.47:0/1234724840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a601011d0 0x7f5a60102e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:29.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a64980700 1 -- 172.21.15.47:0/1234724840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 msgr2=0x7f5a601033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:29.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a64980700 1 --2- 172.21.15.47:0/1234724840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 0x7f5a601033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:29.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a64980700 1 -- 172.21.15.47:0/1234724840 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a601a6600 con 0x7f5a60107210 2024-04-06T03:34:29.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a64980700 1 --2- 172.21.15.47:0/1234724840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a60107210 0x7f5a60103900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800b0a0 tx=0x7f5a58007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.779+0000 7f5a5d7fa700 1 -- 172.21.15.47:0/1234724840 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58021070 con 0x7f5a60107210 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.780+0000 7f5a5d7fa700 1 -- 172.21.15.47:0/1234724840 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f5a5801db00 con 0x7f5a60107210 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.780+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a601a6890 con 0x7f5a60107210 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.780+0000 7f5a5d7fa700 1 -- 172.21.15.47:0/1234724840 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5801b970 con 0x7f5a60107210 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.780+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a601a6d40 con 0x7f5a60107210 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.781+0000 7f5a5d7fa700 1 -- 172.21.15.47:0/1234724840 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 17) ==== 91802+0+0 (secure 0 0 0) 0x7f5a58024070 con 0x7f5a60107210 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.781+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a60068f90 con 0x7f5a60107210 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.781+0000 7f5a5d7fa700 1 --2- 172.21.15.47:0/1234724840 >> v2:172.21.15.47:6800/850698093 conn(0x7f5a4806dbf0 0x7f5a480700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.781+0000 7f5a5ffff700 1 -- 172.21.15.47:0/1234724840 >> v2:172.21.15.47:6800/850698093 conn(0x7f5a4806dbf0 msgr2=0x7f5a480700b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/850698093 2024-04-06T03:34:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.781+0000 7f5a5d7fa700 1 -- 172.21.15.47:0/1234724840 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(71..71 src has 1..71) ==== 6001+0+0 (secure 0 0 0) 0x7f5a5800f020 con 0x7f5a60107210 2024-04-06T03:34:29.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.781+0000 7f5a5ffff700 1 --2- 172.21.15.47:0/1234724840 >> v2:172.21.15.47:6800/850698093 conn(0x7f5a4806dbf0 0x7f5a480700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-06T03:34:29.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.786+0000 7f5a5d7fa700 1 -- 172.21.15.47:0/1234724840 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5a58019320 con 0x7f5a60107210 2024-04-06T03:34:29.834 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:29.537+0000 7f8f52523200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-06T03:34:29.834 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:29.636+0000 7f8f52523200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-06T03:34:29.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.925+0000 7f5a5d7fa700 1 -- 172.21.15.47:0/1234724840 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mgrmap(e 18) ==== 91802+0+0 (secure 0 0 0) 0x7f5a580573d0 con 0x7f5a60107210 2024-04-06T03:34:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.982+0000 7f5a5ffff700 1 -- 172.21.15.47:0/1234724840 >> v2:172.21.15.47:6800/850698093 conn(0x7f5a4806dbf0 msgr2=0x7f5a480700b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/850698093 2024-04-06T03:34:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:29.982+0000 7f5a5ffff700 1 --2- 172.21.15.47:0/1234724840 >> v2:172.21.15.47:6800/850698093 conn(0x7f5a4806dbf0 0x7f5a480700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-06T03:34:30.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.017+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a601a6f10 con 0x7f5a60107210 2024-04-06T03:34:30.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.019+0000 7f5a5d7fa700 1 -- 172.21.15.47:0/1234724840 <== mon.2 v2:172.21.15.47:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+20673 (secure 0 0 0) 0x7f5a5805bd80 con 0x7f5a60107210 2024-04-06T03:34:30.021 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:34:30.021 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":71,"fsid":"8f6329a8-f3c5-11ee-b649-cb9ed24678a4","created":"2024-04-06T03:28:10.981912+0000","modified":"2024-04-06T03:34:15.518293+0000","last_up_change":"2024-04-06T03:33:35.857014+0000","last_in_change":"2024-04-06T03:33:18.570369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-06T03:31:32.766604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2024-04-06T03:33:48.621993+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":64,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-04-06T03:33:49.051577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-04-06T03:33:51.005139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-04-06T03:33:52.955870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-04-06T03:33:55.013690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ec002d7-209e-4bd2-850f-4c843760e184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6801","nonce":1723574942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1723574942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1723574942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":1723574942}]},"public_addr":"172.21.15.47:6801/1723574942","cluster_addr":"172.21.15.47:6802/1723574942","heartbeat_back_addr":"172.21.15.47:6804/1723574942","heartbeat_front_addr":"172.21.15.47:6803/1723574942","state":["exists","up"]},{"osd":1,"uuid":"d9e6ac29-f4e4-4811-a9a7-d206e26183bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":1617120903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1617120903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1617120903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":1617120903}]},"public_addr":"172.21.15.47:6805/1617120903","cluster_addr":"172.21.15.47:6806/1617120903","heartbeat_back_addr":"172.21.15.47:6808/1617120903","heartbeat_front_addr":"172.21.15.47:6807/1617120903","state":["exists","up"]},{"osd":2,"uuid":"00d98fac-1ce6-4422-98e6-d1ad99cdfaf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1442630653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1442630653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1442630653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":1442630653}]},"public_addr":"172.21.15.47:6809/1442630653","cluster_addr":"172.21.15.47:6810/1442630653","heartbeat_back_addr":"172.21.15.47:6812/1442630653","heartbeat_front_addr":"172.21.15.47:6811/1442630653","state":["exists","up"]},{"osd":3,"uuid":"148e8f94-0638-4af1-9a5e-f8ec0ee2cf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":299519913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":299519913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":299519913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":299519913}]},"public_addr":"172.21.15.47:6813/299519913","cluster_addr":"172.21.15.47:6814/299519913","heartbeat_back_addr":"172.21.15.47:6816/299519913","heartbeat_front_addr":"172.21.15.47:6815/299519913","state":["exists","up"]},{"osd":4,"uuid":"ccfd48fd-61bd-46b4-b83a-c8396e41b3a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1031996030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6801","nonce":1031996030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6803","nonce":1031996030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1031996030}]},"public_addr":"172.21.15.102:6800/1031996030","cluster_addr":"172.21.15.102:6801/1031996030","heartbeat_back_addr":"172.21.15.102:6803/1031996030","heartbeat_front_addr":"172.21.15.102:6802/1031996030","state":["exists","up"]},{"osd":5,"uuid":"1411f970-4f9e-4e08-9222-905c8c91835e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":386919126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6805","nonce":386919126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6807","nonce":386919126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":386919126}]},"public_addr":"172.21.15.102:6804/386919126","cluster_addr":"172.21.15.102:6805/386919126","heartbeat_back_addr":"172.21.15.102:6807/386919126","heartbeat_front_addr":"172.21.15.102:6806/386919126","state":["exists","up"]},{"osd":6,"uuid":"1369f589-dc4c-4cd8-94c2-7e89b44fa548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":4105297178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":4105297178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":4105297178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4105297178}]},"public_addr":"172.21.15.102:6808/4105297178","cluster_addr":"172.21.15.102:6809/4105297178","heartbeat_back_addr":"172.21.15.102:6811/4105297178","heartbeat_front_addr":"172.21.15.102:6810/4105297178","state":["exists","up"]},{"osd":7,"uuid":"c782d6e2-04f7-462f-9f3e-ca539b5d8256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3557443636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3557443636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":3557443636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3557443636}]},"public_addr":"172.21.15.102:6812/3557443636","cluster_addr":"172.21.15.102:6813/3557443636","heartbeat_back_addr":"172.21.15.102:6815/3557443636","heartbeat_front_addr":"172.21.15.102:6814/3557443636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:30:38.617682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:03.457695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:29.382721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:31:55.764293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:32:19.310003+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:32:44.054598+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:33:08.591126+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T03:33:34.758478+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/2499466181":"2024-04-07T03:29:14.432037+0000","172.21.15.47:6800/4248661693":"2024-04-07T03:29:14.432037+0000","172.21.15.47:0/3946620428":"2024-04-07T03:29:14.432037+0000","172.21.15.47:0/1620211743":"2024-04-07T03:28:47.430977+0000","172.21.15.47:6800/2668596695":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/2300916716":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/1849130368":"2024-04-07T03:28:47.430977+0000","172.21.15.47:0/1343743305":"2024-04-07T03:29:14.432037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 >> v2:172.21.15.47:6800/850698093 conn(0x7f5a4806dbf0 msgr2=0x7f5a480700b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 --2- 172.21.15.47:0/1234724840 >> v2:172.21.15.47:6800/850698093 conn(0x7f5a4806dbf0 0x7f5a480700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a60107210 msgr2=0x7f5a60103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 --2- 172.21.15.47:0/1234724840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a60107210 0x7f5a60103900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800b0a0 tx=0x7f5a58007a00 comp rx=0 tx=0).stop 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 shutdown_connections 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 --2- 172.21.15.47:0/1234724840 >> v2:172.21.15.47:6800/850698093 conn(0x7f5a4806dbf0 0x7f5a480700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 --2- 172.21.15.47:0/1234724840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a60107210 0x7f5a60103900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 --2- 172.21.15.47:0/1234724840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a601011d0 0x7f5a60102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 --2- 172.21.15.47:0/1234724840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60101b70 0x7f5a601033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 >> 172.21.15.47:0/1234724840 conn(0x7f5a60078100 msgr2=0x7f5a600ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:30.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 shutdown_connections 2024-04-06T03:34:30.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:30.021+0000 7f5a663e3700 1 -- 172.21.15.47:0/1234724840 wait complete. 2024-04-06T03:34:30.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:29.953+0000 7f71cbf49200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-06T03:34:30.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:30.069+0000 7f71cbf49200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-06T03:34:30.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[29365]: Standby manager daemon x restarted 2024-04-06T03:34:30.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[29365]: Standby manager daemon x started 2024-04-06T03:34:30.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[29365]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[29365]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[29365]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[29365]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[37680]: Standby manager daemon x restarted 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[37680]: Standby manager daemon x started 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[37680]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[37680]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[37680]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-06T03:34:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:29 smithi047 ceph-mon[37680]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T03:34:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-mon[32821]: Standby manager daemon x restarted 2024-04-06T03:34:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-mon[32821]: Standby manager daemon x started 2024-04-06T03:34:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-mon[32821]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-06T03:34:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-mon[32821]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T03:34:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-mon[32821]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-06T03:34:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-mon[32821]: from='mgr.? 172.21.15.102:0/2581794559' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T03:34:30.334 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:29.854+0000 7f8f52523200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-06T03:34:30.335 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: [06/Apr/2024:03:34:29] ENGINE Bus STARTING 2024-04-06T03:34:30.335 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: CherryPy Checker: 2024-04-06T03:34:30.335 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: The Application mounted at '' has an empty config. 2024-04-06T03:34:30.335 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: 2024-04-06T03:34:30.335 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: [06/Apr/2024:03:34:29] ENGINE Serving on http://:::9283 2024-04-06T03:34:30.335 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 03:34:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x[34670]: [06/Apr/2024:03:34:29] ENGINE Bus STARTED 2024-04-06T03:34:30.508 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:30.295+0000 7f71cbf49200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-06T03:34:30.508 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:34:30] ENGINE Bus STARTING 2024-04-06T03:34:30.781 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: CherryPy Checker: 2024-04-06T03:34:30.781 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: The Application mounted at '' has an empty config. 2024-04-06T03:34:30.781 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T03:34:30.781 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:34:30] ENGINE Serving on http://:::9283 2024-04-06T03:34:30.781 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:34:30] ENGINE Bus STARTED 2024-04-06T03:34:30.809 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-04-06T03:34:30.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-04-06T03:34:30.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-04-06T03:34:30.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-04-06T03:34:30.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-04-06T03:34:30.812 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-04-06T03:34:30.812 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph tell osd.6 flush_pg_stats 2024-04-06T03:34:30.813 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph tell osd.7 flush_pg_stats 2024-04-06T03:34:31.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: mgrmap e18: y(active, since 5m), standbys: x 2024-04-06T03:34:31.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1234724840' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:34:31.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: Active manager daemon y restarted 2024-04-06T03:34:31.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: Activating manager daemon y 2024-04-06T03:34:31.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: osdmap e72: 8 total, 8 up, 8 in 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: mgrmap e19: y(active, starting, since 0.00958161s), standbys: x 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:34:31.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: Manager daemon y is now available 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: mgrmap e18: y(active, since 5m), standbys: x 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1234724840' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:34:31.248 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: Active manager daemon y restarted 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: Activating manager daemon y 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: osdmap e72: 8 total, 8 up, 8 in 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: mgrmap e19: y(active, starting, since 0.00958161s), standbys: x 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:34:31.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: Manager daemon y is now available 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-06T03:34:31.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-06T03:34:31.325 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:31.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: mgrmap e18: y(active, since 5m), standbys: x 2024-04-06T03:34:31.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1234724840' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T03:34:31.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: Active manager daemon y restarted 2024-04-06T03:34:31.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: Activating manager daemon y 2024-04-06T03:34:31.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: osdmap e72: 8 total, 8 up, 8 in 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: mgrmap e19: y(active, starting, since 0.00958161s), standbys: x 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-06T03:34:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: Manager daemon y is now available 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-06T03:34:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-06T03:34:31.339 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:31.382 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:31.396 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:31.398 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:31.632 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:31.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:34:32.080 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[29365]: [06/Apr/2024:03:34:30] ENGINE Bus STARTING 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[29365]: [06/Apr/2024:03:34:30] ENGINE Serving on http://172.21.15.47:8765 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[29365]: [06/Apr/2024:03:34:30] ENGINE Serving on https://172.21.15.47:7150 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[29365]: [06/Apr/2024:03:34:30] ENGINE Bus STARTED 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[29365]: mgrmap e20: y(active, since 1.02091s), standbys: x 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[37680]: [06/Apr/2024:03:34:30] ENGINE Bus STARTING 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[37680]: [06/Apr/2024:03:34:30] ENGINE Serving on http://172.21.15.47:8765 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[37680]: [06/Apr/2024:03:34:30] ENGINE Serving on https://172.21.15.47:7150 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[37680]: [06/Apr/2024:03:34:30] ENGINE Bus STARTED 2024-04-06T03:34:32.081 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:31 smithi047 ceph-mon[37680]: mgrmap e20: y(active, since 1.02091s), standbys: x 2024-04-06T03:34:32.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:31 smithi102 ceph-mon[32821]: [06/Apr/2024:03:34:30] ENGINE Bus STARTING 2024-04-06T03:34:32.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:31 smithi102 ceph-mon[32821]: [06/Apr/2024:03:34:30] ENGINE Serving on http://172.21.15.47:8765 2024-04-06T03:34:32.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:31 smithi102 ceph-mon[32821]: [06/Apr/2024:03:34:30] ENGINE Serving on https://172.21.15.47:7150 2024-04-06T03:34:32.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:31 smithi102 ceph-mon[32821]: [06/Apr/2024:03:34:30] ENGINE Bus STARTED 2024-04-06T03:34:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:31 smithi102 ceph-mon[32821]: mgrmap e20: y(active, since 1.02091s), standbys: x 2024-04-06T03:34:33.195 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:32 smithi047 ceph-mon[29365]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:33.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:32 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:33.196 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:32 smithi047 ceph-mon[37680]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:33.196 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:32 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:33.272 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:32 smithi102 ceph-mon[32821]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:33.272 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:32 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:33.817 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:34.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:34:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:34:34.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-mon[29365]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:34.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-mon[29365]: mgrmap e21: y(active, since 3s), standbys: x 2024-04-06T03:34:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-mon[37680]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-mon[37680]: mgrmap e21: y(active, since 3s), standbys: x 2024-04-06T03:34:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:33 smithi102 ceph-mon[32821]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:33 smithi102 ceph-mon[32821]: mgrmap e21: y(active, since 3s), standbys: x 2024-04-06T03:34:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:34.594 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi102 to 3760M 2024-04-06T03:34:35.780 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[37680]: mgrmap e22: y(active, since 4s), standbys: x 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi102 to 3760M 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:35.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:35 smithi047 ceph-mon[29365]: mgrmap e22: y(active, since 4s), standbys: x 2024-04-06T03:34:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:34:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi102 to 3760M 2024-04-06T03:34:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:35 smithi102 ceph-mon[32821]: mgrmap e22: y(active, since 4s), standbys: x 2024-04-06T03:34:37.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:37 smithi047 ceph-mon[29365]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:37.951 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:37 smithi047 ceph-mon[37680]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:38.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:37 smithi102 ceph-mon[32821]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:34:39.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:39 smithi047 ceph-mon[29365]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-06T03:34:39.923 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:39 smithi047 ceph-mon[37680]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-06T03:34:40.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:39 smithi102 ceph-mon[32821]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-06T03:34:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.329+0000 7fa90b2e4700 1 -- 172.21.15.47:0/2800060219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 msgr2=0x7fa904105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.329+0000 7fa90b2e4700 1 --2- 172.21.15.47:0/2800060219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 0x7fa904105dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa9000099c0 tx=0x7fa900009cd0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.329+0000 7fa90b2e4700 1 -- 172.21.15.47:0/2800060219 shutdown_connections 2024-04-06T03:34:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.329+0000 7fa90b2e4700 1 --2- 172.21.15.47:0/2800060219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9041064b0 0x7fa90410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.329+0000 7fa90b2e4700 1 --2- 172.21.15.47:0/2800060219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa904101460 0x7fa904101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.329+0000 7fa90b2e4700 1 --2- 172.21.15.47:0/2800060219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 0x7fa904105dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.329+0000 7fa90b2e4700 1 -- 172.21.15.47:0/2800060219 >> 172.21.15.47:0/2800060219 conn(0x7fa904077220 msgr2=0x7fa904077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 -- 172.21.15.47:0/2800060219 shutdown_connections 2024-04-06T03:34:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 -- 172.21.15.47:0/2800060219 wait complete. 2024-04-06T03:34:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 Processor -- start 2024-04-06T03:34:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 -- start start 2024-04-06T03:34:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa904101460 0x7fa904198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 0x7fa904198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9041064b0 0x7fa90419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa904110b60 con 0x7fa904101460 2024-04-06T03:34:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa9041109e0 con 0x7fa9041064b0 2024-04-06T03:34:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90b2e4700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa904110ce0 con 0x7fa904101e10 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90887f700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 0x7fa904198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90887f700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 0x7fa904198790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:58796/0 (socket says 172.21.15.47:58796) 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa90887f700 1 -- 172.21.15.47:0/1403923984 learned_addr learned my addr 172.21.15.47:0/1403923984 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.330+0000 7fa909080700 1 --2- 172.21.15.47:0/1403923984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa904101460 0x7fa904198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa909881700 1 --2- 172.21.15.47:0/1403923984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9041064b0 0x7fa90419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa90887f700 1 -- 172.21.15.47:0/1403923984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9041064b0 msgr2=0x7fa90419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa90887f700 1 --2- 172.21.15.47:0/1403923984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9041064b0 0x7fa90419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa90887f700 1 -- 172.21.15.47:0/1403923984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa904101460 msgr2=0x7fa904198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa90887f700 1 --2- 172.21.15.47:0/1403923984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa904101460 0x7fa904198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa90887f700 1 -- 172.21.15.47:0/1403923984 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90419d260 con 0x7fa904101e10 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa909080700 1 --2- 172.21.15.47:0/1403923984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa904101460 0x7fa904198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa90887f700 1 --2- 172.21.15.47:0/1403923984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 0x7fa904198790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa90000f670 tx=0x7fa90000f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900027070 con 0x7fa904101e10 2024-04-06T03:34:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90419d4f0 con 0x7fa904101e10 2024-04-06T03:34:40.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fa900022470 con 0x7fa904101e10 2024-04-06T03:34:40.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900009e60 con 0x7fa904101e10 2024-04-06T03:34:40.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.331+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa904102da0 con 0x7fa904101e10 2024-04-06T03:34:40.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.332+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa904105c20 con 0x7fa904101e10 2024-04-06T03:34:40.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fa90002a070 con 0x7fa904101e10 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa8fa7fc700 1 --2- 172.21.15.47:0/1403923984 >> v2:172.21.15.47:6800/3359778320 conn(0x7fa8f006dc00 0x7fa8f00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7fa90008e580 con 0x7fa904101e10 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa909080700 1 --2- 172.21.15.47:0/1403923984 >> v2:172.21.15.47:6800/3359778320 conn(0x7fa8f006dc00 0x7fa8f00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa8fa7fc700 1 --2- 172.21.15.47:0/1403923984 >> v2:172.21.15.102:6800/1031996030 conn(0x7fa8f00774a0 0x7fa8f0079940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 --> v2:172.21.15.102:6800/1031996030 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa90000b790 con 0x7fa8f00774a0 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fa900095050 con 0x7fa904101e10 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa909080700 1 --2- 172.21.15.47:0/1403923984 >> v2:172.21.15.47:6800/3359778320 conn(0x7fa8f006dc00 0x7fa8f00700c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40104e0 tx=0x7fa8f400b3c0 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.333+0000 7fa909881700 1 --2- 172.21.15.47:0/1403923984 >> v2:172.21.15.102:6800/1031996030 conn(0x7fa8f00774a0 0x7fa8f0079940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.334+0000 7fa909881700 1 --2- 172.21.15.47:0/1403923984 >> v2:172.21.15.102:6800/1031996030 conn(0x7fa8f00774a0 0x7fa8f0079940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:40.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.335+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 <== osd.4 v2:172.21.15.102:6800/1031996030 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa90000b790 con 0x7fa8f00774a0 2024-04-06T03:34:40.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.351+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 --> v2:172.21.15.102:6800/1031996030 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa9041028b0 con 0x7fa8f00774a0 2024-04-06T03:34:40.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa8fa7fc700 1 -- 172.21.15.47:0/1403923984 <== osd.4 v2:172.21.15.102:6800/1031996030 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa9041028b0 con 0x7fa8f00774a0 2024-04-06T03:34:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 >> v2:172.21.15.102:6800/1031996030 conn(0x7fa8f00774a0 msgr2=0x7fa8f0079940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 --2- 172.21.15.47:0/1403923984 >> v2:172.21.15.102:6800/1031996030 conn(0x7fa8f00774a0 0x7fa8f0079940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 >> v2:172.21.15.47:6800/3359778320 conn(0x7fa8f006dc00 msgr2=0x7fa8f00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 --2- 172.21.15.47:0/1403923984 >> v2:172.21.15.47:6800/3359778320 conn(0x7fa8f006dc00 0x7fa8f00700c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40104e0 tx=0x7fa8f400b3c0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 msgr2=0x7fa904198790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 --2- 172.21.15.47:0/1403923984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa904101e10 0x7fa904198790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa90000f670 tx=0x7fa90000f6a0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa909881700 1 -- 172.21.15.47:0/1403923984 reap_dead start 2024-04-06T03:34:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 shutdown_connections 2024-04-06T03:34:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 >> 172.21.15.47:0/1403923984 conn(0x7fa904077220 msgr2=0x7fa904105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 shutdown_connections 2024-04-06T03:34:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.352+0000 7fa90b2e4700 1 -- 172.21.15.47:0/1403923984 wait complete. 2024-04-06T03:34:40.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 -- 172.21.15.47:0/2599896419 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c107650 msgr2=0x7f489c10f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 --2- 172.21.15.47:0/2599896419 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c107650 0x7f489c10f1d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48940099c0 tx=0x7f4894009cd0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 -- 172.21.15.47:0/2599896419 shutdown_connections 2024-04-06T03:34:40.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 --2- 172.21.15.47:0/2599896419 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c107650 0x7f489c10f1d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 --2- 172.21.15.47:0/2599896419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c06ac90 0x7f489c06b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 --2- 172.21.15.47:0/2599896419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f489c06b640 0x7f489c106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 -- 172.21.15.47:0/2599896419 >> 172.21.15.47:0/2599896419 conn(0x7f489c0771e0 msgr2=0x7f489c0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:40.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 -- 172.21.15.47:0/2599896419 shutdown_connections 2024-04-06T03:34:40.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.530+0000 7f48a0bac700 1 -- 172.21.15.47:0/2599896419 wait complete. 2024-04-06T03:34:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f48a0bac700 1 Processor -- start 2024-04-06T03:34:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f48a0bac700 1 -- start start 2024-04-06T03:34:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f48a0bac700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c06ac90 0x7f489c1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f48a0bac700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f489c06b640 0x7f489c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f48a0bac700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c107650 0x7f489c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f48a0bac700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f489c111d00 con 0x7f489c107650 2024-04-06T03:34:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f48a0bac700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f489c111b80 con 0x7f489c06b640 2024-04-06T03:34:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f48a0bac700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f489c111e80 con 0x7f489c06ac90 2024-04-06T03:34:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f489a59c700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c06ac90 0x7f489c1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f489a59c700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c06ac90 0x7f489c1980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:58812/0 (socket says 172.21.15.47:58812) 2024-04-06T03:34:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f489a59c700 1 -- 172.21.15.47:0/2282712528 learned_addr learned my addr 172.21.15.47:0/2282712528 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f489ad9d700 1 --2- 172.21.15.47:0/2282712528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c107650 0x7f489c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.531+0000 7f4899d9b700 1 --2- 172.21.15.47:0/2282712528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f489c06b640 0x7f489c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f489a59c700 1 -- 172.21.15.47:0/2282712528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f489c06b640 msgr2=0x7f489c198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f489a59c700 1 --2- 172.21.15.47:0/2282712528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f489c06b640 0x7f489c198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f489a59c700 1 -- 172.21.15.47:0/2282712528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c107650 msgr2=0x7f489c19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f489a59c700 1 --2- 172.21.15.47:0/2282712528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c107650 0x7f489c19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f489a59c700 1 -- 172.21.15.47:0/2282712528 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c19d0f0 con 0x7f489c06ac90 2024-04-06T03:34:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f489ad9d700 1 --2- 172.21.15.47:0/2282712528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f489c107650 0x7f489c19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f489a59c700 1 --2- 172.21.15.47:0/2282712528 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c06ac90 0x7f489c1980e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c370 tx=0x7f488c00c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c0092e0 con 0x7f489c06ac90 2024-04-06T03:34:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f488c00cbe0 con 0x7f489c06ac90 2024-04-06T03:34:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489c19d380 con 0x7f489c06ac90 2024-04-06T03:34:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c0046e0 con 0x7f489c06ac90 2024-04-06T03:34:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.532+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f489c1a4c60 con 0x7f489c06ac90 2024-04-06T03:34:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.533+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f489c0ffa50 con 0x7f489c06ac90 2024-04-06T03:34:40.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.533+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f488c01a020 con 0x7f489c06ac90 2024-04-06T03:34:40.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f48937fe700 1 --2- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6800/3359778320 conn(0x7f488806dc00 0x7f48880700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f488c08df50 con 0x7f489c06ac90 2024-04-06T03:34:40.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f4899d9b700 1 --2- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6800/3359778320 conn(0x7f488806dc00 0x7f48880700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f48937fe700 1 --2- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6805/1617120903 conn(0x7f48880774a0 0x7f4888079940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:40.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 --> v2:172.21.15.47:6805/1617120903 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f488c00dea0 con 0x7f48880774a0 2024-04-06T03:34:40.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f488c08e3e0 con 0x7f489c06ac90 2024-04-06T03:34:40.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f489ad9d700 1 --2- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6805/1617120903 conn(0x7f48880774a0 0x7f4888079940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:40.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f4899d9b700 1 --2- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6800/3359778320 conn(0x7f488806dc00 0x7f48880700c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f489c100e20 tx=0x7f488400b410 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:40.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.534+0000 7f489ad9d700 1 --2- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6805/1617120903 conn(0x7f48880774a0 0x7f4888079940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:40.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.535+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 <== osd.1 v2:172.21.15.47:6805/1617120903 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f488c00dea0 con 0x7f48880774a0 2024-04-06T03:34:40.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.551+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 --> v2:172.21.15.47:6805/1617120903 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f489c103a00 con 0x7f48880774a0 2024-04-06T03:34:40.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48937fe700 1 -- 172.21.15.47:0/2282712528 <== osd.1 v2:172.21.15.47:6805/1617120903 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f489c103a00 con 0x7f48880774a0 2024-04-06T03:34:40.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6805/1617120903 conn(0x7f48880774a0 msgr2=0x7f4888079940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 --2- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6805/1617120903 conn(0x7f48880774a0 0x7f4888079940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:40.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6800/3359778320 conn(0x7f488806dc00 msgr2=0x7f48880700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 --2- 172.21.15.47:0/2282712528 >> v2:172.21.15.47:6800/3359778320 conn(0x7f488806dc00 0x7f48880700c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f489c100e20 tx=0x7f488400b410 comp rx=0 tx=0).stop 2024-04-06T03:34:40.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c06ac90 msgr2=0x7f489c1980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:40.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 --2- 172.21.15.47:0/2282712528 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f489c06ac90 0x7f489c1980e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c370 tx=0x7f488c00c680 comp rx=0 tx=0).stop 2024-04-06T03:34:40.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f489ad9d700 1 -- 172.21.15.47:0/2282712528 reap_dead start 2024-04-06T03:34:40.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 shutdown_connections 2024-04-06T03:34:40.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 >> 172.21.15.47:0/2282712528 conn(0x7f489c0771e0 msgr2=0x7f489c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:40.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 shutdown_connections 2024-04-06T03:34:40.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:40.552+0000 7f48a0bac700 1 -- 172.21.15.47:0/2282712528 wait complete. 2024-04-06T03:34:41.467 INFO:teuthology.orchestra.run.smithi047.stdout:128849018908 2024-04-06T03:34:41.467 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-04-06T03:34:41.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:41 smithi047 ceph-mon[29365]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-06T03:34:41.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:41 smithi047 ceph-mon[37680]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-06T03:34:41.856 INFO:teuthology.orchestra.run.smithi047.stdout:55834574893 2024-04-06T03:34:41.856 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-04-06T03:34:42.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:34:42.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:41 smithi102 ceph-mon[32821]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.471+0000 7fc41fb6f700 1 -- 172.21.15.47:0/3740226100 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc418102510 msgr2=0x7fc4181028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.471+0000 7fc41fb6f700 1 --2- 172.21.15.47:0/3740226100 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc418102510 0x7fc4181028f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc41000b0d0 tx=0x7fc41000b3e0 comp rx=0 tx=0).stop 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.471+0000 7fc41fb6f700 1 -- 172.21.15.47:0/3740226100 shutdown_connections 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.471+0000 7fc41fb6f700 1 --2- 172.21.15.47:0/3740226100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4181075f0 0x7fc41810f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 --2- 172.21.15.47:0/3740226100 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc418102510 0x7fc4181028f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 --2- 172.21.15.47:0/3740226100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc418102ec0 0x7fc418106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 -- 172.21.15.47:0/3740226100 >> 172.21.15.47:0/3740226100 conn(0x7fc4180fdd80 msgr2=0x7fc4181001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 -- 172.21.15.47:0/3740226100 shutdown_connections 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 -- 172.21.15.47:0/3740226100 wait complete. 2024-04-06T03:34:42.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 Processor -- start 2024-04-06T03:34:42.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 -- start start 2024-04-06T03:34:42.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc418102510 0x7fc4180745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:42.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.472+0000 7fc41fb6f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc418102ec0 0x7fc418074b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:42.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41fb6f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4181075f0 0x7fc418075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:42.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41fb6f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc418111ca0 con 0x7fc418102ec0 2024-04-06T03:34:42.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41fb6f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc418111b20 con 0x7fc4181075f0 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41fb6f700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc418111e20 con 0x7fc418102510 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc418102ec0 0x7fc418074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc418102ec0 0x7fc418074b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34956/0 (socket says 172.21.15.47:34956) 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 -- 172.21.15.47:0/2578451261 learned_addr learned my addr 172.21.15.47:0/2578451261 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d90b700 1 --2- 172.21.15.47:0/2578451261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc418102510 0x7fc4180745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41e10c700 1 --2- 172.21.15.47:0/2578451261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4181075f0 0x7fc418075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 -- 172.21.15.47:0/2578451261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc418102510 msgr2=0x7fc4180745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 --2- 172.21.15.47:0/2578451261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc418102510 0x7fc4180745d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 -- 172.21.15.47:0/2578451261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4181075f0 msgr2=0x7fc418075050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 --2- 172.21.15.47:0/2578451261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4181075f0 0x7fc418075050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 -- 172.21.15.47:0/2578451261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4181a6670 con 0x7fc418102ec0 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d90b700 1 --2- 172.21.15.47:0/2578451261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc418102510 0x7fc4180745d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:42.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41d10a700 1 --2- 172.21.15.47:0/2578451261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc418102ec0 0x7fc418074b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc40800ea30 tx=0x7fc40800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40800cbd0 con 0x7fc418102ec0 2024-04-06T03:34:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc4080044d0 con 0x7fc418102ec0 2024-04-06T03:34:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.473+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4181a6960 con 0x7fc418102ec0 2024-04-06T03:34:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.474+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408003d80 con 0x7fc418102ec0 2024-04-06T03:34:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.474+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4181a6ea0 con 0x7fc418102ec0 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.475+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4180feac0 con 0x7fc418102ec0 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.475+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fc408003fe0 con 0x7fc418102ec0 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.476+0000 7fc40effd700 1 --2- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc40406dae0 0x7fc40406ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.476+0000 7fc41d90b700 1 --2- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc40406dae0 0x7fc40406ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.476+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7fc40808dbd0 con 0x7fc418102ec0 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.476+0000 7fc40effd700 1 --2- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6813/299519913 conn(0x7fc404077300 0x7fc4040797a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.476+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 --> v2:172.21.15.47:6813/299519913 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc408013ec0 con 0x7fc404077300 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.476+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fc4080932a0 con 0x7fc418102ec0 2024-04-06T03:34:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.476+0000 7fc41e10c700 1 --2- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6813/299519913 conn(0x7fc404077300 0x7fc4040797a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:42.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.476+0000 7fc41d90b700 1 --2- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc40406dae0 0x7fc40406ffa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc410009fd0 tx=0x7fc41000b040 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:42.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.477+0000 7fc41e10c700 1 --2- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6813/299519913 conn(0x7fc404077300 0x7fc4040797a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:42.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.477+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 <== osd.3 v2:172.21.15.47:6813/299519913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc408013ec0 con 0x7fc404077300 2024-04-06T03:34:42.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.493+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 --> v2:172.21.15.47:6813/299519913 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4181039f0 con 0x7fc404077300 2024-04-06T03:34:42.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc40effd700 1 -- 172.21.15.47:0/2578451261 <== osd.3 v2:172.21.15.47:6813/299519913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc4181039f0 con 0x7fc404077300 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6813/299519913 conn(0x7fc404077300 msgr2=0x7fc4040797a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 --2- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6813/299519913 conn(0x7fc404077300 0x7fc4040797a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc40406dae0 msgr2=0x7fc40406ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 --2- 172.21.15.47:0/2578451261 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc40406dae0 0x7fc40406ffa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc410009fd0 tx=0x7fc41000b040 comp rx=0 tx=0).stop 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc418102ec0 msgr2=0x7fc418074b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 --2- 172.21.15.47:0/2578451261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc418102ec0 0x7fc418074b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc40800ea30 tx=0x7fc40800ed40 comp rx=0 tx=0).stop 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41e10c700 1 -- 172.21.15.47:0/2578451261 reap_dead start 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 shutdown_connections 2024-04-06T03:34:42.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 >> 172.21.15.47:0/2578451261 conn(0x7fc4180fdd80 msgr2=0x7fc4180fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:42.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 shutdown_connections 2024-04-06T03:34:42.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:42.494+0000 7fc41fb6f700 1 -- 172.21.15.47:0/2578451261 wait complete. 2024-04-06T03:34:42.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:42 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:42.907 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:42 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:43.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:42 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 -- 172.21.15.47:0/3174739825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1164102320 msgr2=0x7f11641027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 --2- 172.21.15.47:0/3174739825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1164102320 0x7f11641027a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11540099c0 tx=0x7f1154009cd0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 -- 172.21.15.47:0/3174739825 shutdown_connections 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 --2- 172.21.15.47:0/3174739825 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1164102ce0 0x7f116410f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 --2- 172.21.15.47:0/3174739825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1164108300 0x7f11641086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 --2- 172.21.15.47:0/3174739825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1164102320 0x7f11641027a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 -- 172.21.15.47:0/3174739825 >> 172.21.15.47:0/3174739825 conn(0x7f1164079400 msgr2=0x7f1164079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 -- 172.21.15.47:0/3174739825 shutdown_connections 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 -- 172.21.15.47:0/3174739825 wait complete. 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.511+0000 7f116b678700 1 Processor -- start 2024-04-06T03:34:43.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f116b678700 1 -- start start 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f116b678700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1164102320 0x7f11641980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f116b678700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1164102ce0 0x7f1164198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f116b678700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1164108300 0x7f116419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f116b678700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1164111c90 con 0x7f1164102ce0 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f116b678700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1164111b10 con 0x7f1164108300 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f116b678700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f1164111e10 con 0x7f1164102320 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1169414700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1164102320 0x7f11641980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1168c13700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1164102ce0 0x7f1164198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1169414700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1164102320 0x7f11641980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:58864/0 (socket says 172.21.15.47:58864) 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1169414700 1 -- 172.21.15.47:0/1870544467 learned_addr learned my addr 172.21.15.47:0/1870544467 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1169c15700 1 --2- 172.21.15.47:0/1870544467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1164108300 0x7f116419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1168c13700 1 -- 172.21.15.47:0/1870544467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1164102320 msgr2=0x7f11641980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1168c13700 1 --2- 172.21.15.47:0/1870544467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1164102320 0x7f11641980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1168c13700 1 -- 172.21.15.47:0/1870544467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1164108300 msgr2=0x7f116419c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1168c13700 1 --2- 172.21.15.47:0/1870544467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1164108300 0x7f116419c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1168c13700 1 -- 172.21.15.47:0/1870544467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116419d090 con 0x7f1164102ce0 2024-04-06T03:34:43.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1169c15700 1 --2- 172.21.15.47:0/1870544467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1164108300 0x7f116419c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-06T03:34:43.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1169414700 1 --2- 172.21.15.47:0/1870544467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1164102320 0x7f11641980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:43.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.512+0000 7f1168c13700 1 --2- 172.21.15.47:0/1870544467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1164102ce0 0x7f1164198610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11540098e0 tx=0x7f115400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:43.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.513+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154027070 con 0x7f1164102ce0 2024-04-06T03:34:43.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.513+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f115400fb60 con 0x7f1164102ce0 2024-04-06T03:34:43.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.513+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116419d320 con 0x7f1164102ce0 2024-04-06T03:34:43.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.513+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154022de0 con 0x7f1164102ce0 2024-04-06T03:34:43.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.513+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11641a4c00 con 0x7f1164102ce0 2024-04-06T03:34:43.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.513+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11641078a0 con 0x7f1164102ce0 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.514+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f115402a070 con 0x7f1164102ce0 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.514+0000 7f115a7fc700 1 --2- 172.21.15.47:0/1870544467 >> v2:172.21.15.47:6800/3359778320 conn(0x7f115006dc00 0x7f11500700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.515+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f115408ef60 con 0x7f1164102ce0 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.515+0000 7f1169414700 1 --2- 172.21.15.47:0/1870544467 >> v2:172.21.15.47:6800/3359778320 conn(0x7f115006dc00 0x7f11500700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.515+0000 7f115a7fc700 1 --2- 172.21.15.47:0/1870544467 >> v2:172.21.15.102:6804/386919126 conn(0x7f11500774a0 0x7f1150079940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.515+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 --> v2:172.21.15.102:6804/386919126 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1150079fd0 con 0x7f11500774a0 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.515+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f115408f3f0 con 0x7f1164102ce0 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.515+0000 7f1169c15700 1 --2- 172.21.15.47:0/1870544467 >> v2:172.21.15.102:6804/386919126 conn(0x7f11500774a0 0x7f1150079940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.515+0000 7f1169414700 1 --2- 172.21.15.47:0/1870544467 >> v2:172.21.15.47:6800/3359778320 conn(0x7f115006dc00 0x7f11500700c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1160009fd0 tx=0x7f1160009040 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:43.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.515+0000 7f1169c15700 1 --2- 172.21.15.47:0/1870544467 >> v2:172.21.15.102:6804/386919126 conn(0x7f11500774a0 0x7f1150079940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:43.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.516+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 <== osd.5 v2:172.21.15.102:6804/386919126 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1150079fd0 con 0x7f11500774a0 2024-04-06T03:34:43.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.533+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 --> v2:172.21.15.102:6804/386919126 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11641039b0 con 0x7f11500774a0 2024-04-06T03:34:43.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.533+0000 7f115a7fc700 1 -- 172.21.15.47:0/1870544467 <== osd.5 v2:172.21.15.102:6804/386919126 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f11641039b0 con 0x7f11500774a0 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 >> v2:172.21.15.102:6804/386919126 conn(0x7f11500774a0 msgr2=0x7f1150079940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 --2- 172.21.15.47:0/1870544467 >> v2:172.21.15.102:6804/386919126 conn(0x7f11500774a0 0x7f1150079940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 >> v2:172.21.15.47:6800/3359778320 conn(0x7f115006dc00 msgr2=0x7f11500700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 --2- 172.21.15.47:0/1870544467 >> v2:172.21.15.47:6800/3359778320 conn(0x7f115006dc00 0x7f11500700c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1160009fd0 tx=0x7f1160009040 comp rx=0 tx=0).stop 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1164102ce0 msgr2=0x7f1164198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 --2- 172.21.15.47:0/1870544467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1164102ce0 0x7f1164198610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11540098e0 tx=0x7f115400f670 comp rx=0 tx=0).stop 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f1169c15700 1 -- 172.21.15.47:0/1870544467 reap_dead start 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 shutdown_connections 2024-04-06T03:34:43.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 >> 172.21.15.47:0/1870544467 conn(0x7f1164079400 msgr2=0x7f1164105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:43.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 shutdown_connections 2024-04-06T03:34:43.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.534+0000 7f116b678700 1 -- 172.21.15.47:0/1870544467 wait complete. 2024-04-06T03:34:43.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:43 smithi047 ceph-mon[29365]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-06T03:34:43.855 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:34:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:34:43.855 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:43 smithi047 ceph-mon[37680]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-06T03:34:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.009+0000 7f1fa472f700 1 -- 172.21.15.47:0/207016605 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 msgr2=0x7f1f9c10f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.009+0000 7f1fa472f700 1 --2- 172.21.15.47:0/207016605 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 0x7f1f9c10f120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400b0a0 tx=0x7f1f9400b3b0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 -- 172.21.15.47:0/207016605 shutdown_connections 2024-04-06T03:34:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 --2- 172.21.15.47:0/207016605 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 0x7f1f9c10f120 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 --2- 172.21.15.47:0/207016605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c108300 0x7f1f9c1086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 --2- 172.21.15.47:0/207016605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9c102320 0x7f1f9c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 -- 172.21.15.47:0/207016605 >> 172.21.15.47:0/207016605 conn(0x7f1f9c079400 msgr2=0x7f1f9c079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 -- 172.21.15.47:0/207016605 shutdown_connections 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 -- 172.21.15.47:0/207016605 wait complete. 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 Processor -- start 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 -- start start 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9c102320 0x7f1f9c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 0x7f1f9c074b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c108300 0x7f1f9c075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c111c80 con 0x7f1f9c108300 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c111b00 con 0x7f1f9c102320 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.010+0000 7f1fa472f700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c111e00 con 0x7f1f9c102ce0 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 0x7f1f9c074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa2ccc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c108300 0x7f1f9c075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 0x7f1f9c074b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:58846/0 (socket says 172.21.15.47:58846) 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 -- 172.21.15.47:0/3646164688 learned_addr learned my addr 172.21.15.47:0/3646164688 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa24cb700 1 --2- 172.21.15.47:0/3646164688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9c102320 0x7f1f9c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 -- 172.21.15.47:0/3646164688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9c102320 msgr2=0x7f1f9c0745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 --2- 172.21.15.47:0/3646164688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9c102320 0x7f1f9c0745d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 -- 172.21.15.47:0/3646164688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c108300 msgr2=0x7f1f9c075050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 --2- 172.21.15.47:0/3646164688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c108300 0x7f1f9c075050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 -- 172.21.15.47:0/3646164688 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c1a6590 con 0x7f1f9c102ce0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa1cca700 1 --2- 172.21.15.47:0/3646164688 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 0x7f1f9c074b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00d980 tx=0x7f1f8c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c016070 con 0x7f1f9c102ce0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f1f8c004830 con 0x7f1f9c102ce0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c1a6880 con 0x7f1f9c102ce0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c005490 con 0x7f1f9c102ce0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.011+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c1a6e10 con 0x7f1f9c102ce0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.012+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f9c107860 con 0x7f1f9c102ce0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.013+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f1f8c004220 con 0x7f1f9c102ce0 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.013+0000 7f1f937fe700 1 --2- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6800/3359778320 conn(0x7f1f8806dc00 0x7f1f880700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.013+0000 7f1fa24cb700 1 --2- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6800/3359778320 conn(0x7f1f8806dc00 0x7f1f880700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.013+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f1f8c08d830 con 0x7f1f9c102ce0 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.013+0000 7f1f937fe700 1 --2- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6809/1442630653 conn(0x7f1f88077520 0x7f1f880799c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.013+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 --> v2:172.21.15.47:6809/1442630653 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f8807a050 con 0x7f1f88077520 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.013+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f1f8c0922c0 con 0x7f1f9c102ce0 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.013+0000 7f1fa2ccc700 1 --2- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6809/1442630653 conn(0x7f1f88077520 0x7f1f880799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.014+0000 7f1fa24cb700 1 --2- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6800/3359778320 conn(0x7f1f8806dc00 0x7f1f880700c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009680 tx=0x7f1f98009260 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.014+0000 7f1fa2ccc700 1 --2- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6809/1442630653 conn(0x7f1f88077520 0x7f1f880799c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.014+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 <== osd.2 v2:172.21.15.47:6809/1442630653 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f8807a050 con 0x7f1f88077520 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 --> v2:172.21.15.47:6809/1442630653 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f9c1039b0 con 0x7f1f88077520 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1f937fe700 1 -- 172.21.15.47:0/3646164688 <== osd.2 v2:172.21.15.47:6809/1442630653 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f9c1039b0 con 0x7f1f88077520 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6809/1442630653 conn(0x7f1f88077520 msgr2=0x7f1f880799c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 --2- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6809/1442630653 conn(0x7f1f88077520 0x7f1f880799c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6800/3359778320 conn(0x7f1f8806dc00 msgr2=0x7f1f880700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 --2- 172.21.15.47:0/3646164688 >> v2:172.21.15.47:6800/3359778320 conn(0x7f1f8806dc00 0x7f1f880700c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009680 tx=0x7f1f98009260 comp rx=0 tx=0).stop 2024-04-06T03:34:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 msgr2=0x7f1f9c074b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 --2- 172.21.15.47:0/3646164688 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1f9c102ce0 0x7f1f9c074b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00d980 tx=0x7f1f8c00dc90 comp rx=0 tx=0).stop 2024-04-06T03:34:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa2ccc700 1 -- 172.21.15.47:0/3646164688 reap_dead start 2024-04-06T03:34:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 shutdown_connections 2024-04-06T03:34:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 >> 172.21.15.47:0/3646164688 conn(0x7f1f9c079400 msgr2=0x7f1f9c105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 shutdown_connections 2024-04-06T03:34:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:43.031+0000 7f1fa472f700 1 -- 172.21.15.47:0/3646164688 wait complete. 2024-04-06T03:34:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:43 smithi102 ceph-mon[32821]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 -- 172.21.15.47:0/845666522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4818108350 msgr2=0x7f4818108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 --2- 172.21.15.47:0/845666522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4818108350 0x7f4818108730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4808009920 tx=0x7f4808009c30 comp rx=0 tx=0).stop 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 -- 172.21.15.47:0/845666522 shutdown_connections 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 --2- 172.21.15.47:0/845666522 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f481806b370 0x7f481810f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 --2- 172.21.15.47:0/845666522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4818108350 0x7f4818108730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 --2- 172.21.15.47:0/845666522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f481806a9d0 0x7f481806ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 -- 172.21.15.47:0/845666522 >> 172.21.15.47:0/845666522 conn(0x7f48180771f0 msgr2=0x7f4818077600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 -- 172.21.15.47:0/845666522 shutdown_connections 2024-04-06T03:34:45.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 -- 172.21.15.47:0/845666522 wait complete. 2024-04-06T03:34:45.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.027+0000 7f481f0ee700 1 Processor -- start 2024-04-06T03:34:45.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481f0ee700 1 -- start start 2024-04-06T03:34:45.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481f0ee700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f481806a9d0 0x7f4818198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:45.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481f0ee700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f481806b370 0x7f4818198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:45.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481f0ee700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4818108350 0x7f481819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481f0ee700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4818111cc0 con 0x7f481806a9d0 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481f0ee700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4818111b40 con 0x7f4818108350 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481f0ee700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f4818111e40 con 0x7f481806b370 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f481806a9d0 0x7f4818198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f4817fff700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f481806b370 0x7f4818198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f481806a9d0 0x7f4818198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35010/0 (socket says 172.21.15.47:35010) 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 -- 172.21.15.47:0/2773971678 learned_addr learned my addr 172.21.15.47:0/2773971678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481d68b700 1 --2- 172.21.15.47:0/2773971678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4818108350 0x7f481819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 -- 172.21.15.47:0/2773971678 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f481806b370 msgr2=0x7f4818198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 --2- 172.21.15.47:0/2773971678 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f481806b370 0x7f4818198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 -- 172.21.15.47:0/2773971678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4818108350 msgr2=0x7f481819cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 --2- 172.21.15.47:0/2773971678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4818108350 0x7f481819cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 -- 172.21.15.47:0/2773971678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481819d250 con 0x7f481806a9d0 2024-04-06T03:34:45.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f481ce8a700 1 --2- 172.21.15.47:0/2773971678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f481806a9d0 0x7f4818198240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4808009230 tx=0x7f480800fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:45.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.028+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808027070 con 0x7f481806a9d0 2024-04-06T03:34:45.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.029+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481819d4e0 con 0x7f481806a9d0 2024-04-06T03:34:45.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.029+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f4808005570 con 0x7f481806a9d0 2024-04-06T03:34:45.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.029+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808004930 con 0x7f481806a9d0 2024-04-06T03:34:45.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.029+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48181a4dc0 con 0x7f481806a9d0 2024-04-06T03:34:45.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.029+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48181078f0 con 0x7f481806a9d0 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.030+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f480802a070 con 0x7f481806a9d0 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f4815ffb700 1 --2- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6800/3359778320 conn(0x7f480006dc00 0x7f48000700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f480808ed40 con 0x7f481806a9d0 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f4817fff700 1 --2- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6800/3359778320 conn(0x7f480006dc00 0x7f48000700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f4815ffb700 1 --2- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6801/1723574942 conn(0x7f4800077520 0x7f48000799c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 --> v2:172.21.15.47:6801/1723574942 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4808015e50 con 0x7f4800077520 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f480808f0f0 con 0x7f481806a9d0 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f481d68b700 1 --2- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6801/1723574942 conn(0x7f4800077520 0x7f48000799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:45.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f4817fff700 1 --2- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6800/3359778320 conn(0x7f480006dc00 0x7f48000700c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4818112860 tx=0x7f480c009190 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:45.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.031+0000 7f481d68b700 1 --2- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6801/1723574942 conn(0x7f4800077520 0x7f48000799c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:45.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.032+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 <== osd.0 v2:172.21.15.47:6801/1723574942 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4808015e50 con 0x7f4800077520 2024-04-06T03:34:45.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.048+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 --> v2:172.21.15.47:6801/1723574942 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4818103a00 con 0x7f4800077520 2024-04-06T03:34:45.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.048+0000 7f4815ffb700 1 -- 172.21.15.47:0/2773971678 <== osd.0 v2:172.21.15.47:6801/1723574942 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4818103a00 con 0x7f4800077520 2024-04-06T03:34:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6801/1723574942 conn(0x7f4800077520 msgr2=0x7f48000799c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 --2- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6801/1723574942 conn(0x7f4800077520 0x7f48000799c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6800/3359778320 conn(0x7f480006dc00 msgr2=0x7f48000700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 --2- 172.21.15.47:0/2773971678 >> v2:172.21.15.47:6800/3359778320 conn(0x7f480006dc00 0x7f48000700c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4818112860 tx=0x7f480c009190 comp rx=0 tx=0).stop 2024-04-06T03:34:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f481806a9d0 msgr2=0x7f4818198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 --2- 172.21.15.47:0/2773971678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f481806a9d0 0x7f4818198240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4808009230 tx=0x7f480800fb40 comp rx=0 tx=0).stop 2024-04-06T03:34:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481d68b700 1 -- 172.21.15.47:0/2773971678 reap_dead start 2024-04-06T03:34:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 shutdown_connections 2024-04-06T03:34:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 >> 172.21.15.47:0/2773971678 conn(0x7f48180771f0 msgr2=0x7f4818105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 shutdown_connections 2024-04-06T03:34:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.049+0000 7f481f0ee700 1 -- 172.21.15.47:0/2773971678 wait complete. 2024-04-06T03:34:45.169 INFO:teuthology.orchestra.run.smithi047.stdout:77309411369 2024-04-06T03:34:45.170 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-04-06T03:34:45.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:45 smithi047 ceph-mon[29365]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:45.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:45 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:34:45.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:45 smithi047 ceph-mon[37680]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:45.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:45 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:34:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:45 smithi102 ceph-mon[32821]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:45 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:34:46.214 INFO:teuthology.orchestra.run.smithi047.stdout:107374182435 2024-04-06T03:34:46.215 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-04-06T03:34:46.329 INFO:teuthology.orchestra.run.smithi047.stdout:34359738418 2024-04-06T03:34:46.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-04-06T03:34:46.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 -- 172.21.15.47:0/4190640918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c108300 msgr2=0x7f102c1086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 --2- 172.21.15.47:0/4190640918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c108300 0x7f102c1086e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f10280099c0 tx=0x7f1028009cd0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 -- 172.21.15.47:0/4190640918 shutdown_connections 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 --2- 172.21.15.47:0/4190640918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f102c102ce0 0x7f102c10f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 --2- 172.21.15.47:0/4190640918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c108300 0x7f102c1086e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 --2- 172.21.15.47:0/4190640918 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f102c102320 0x7f102c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 -- 172.21.15.47:0/4190640918 >> 172.21.15.47:0/4190640918 conn(0x7f102c079400 msgr2=0x7f102c079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 -- 172.21.15.47:0/4190640918 shutdown_connections 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.545+0000 7f1033c08700 1 -- 172.21.15.47:0/4190640918 wait complete. 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f1033c08700 1 Processor -- start 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f1033c08700 1 -- start start 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f1033c08700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f102c102320 0x7f102c198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f1033c08700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c102ce0 0x7f102c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f1033c08700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f102c108300 0x7f102c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f1033c08700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f102c111cb0 con 0x7f102c102ce0 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f1033c08700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f102c111b30 con 0x7f102c108300 2024-04-06T03:34:46.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f1033c08700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f102c111e30 con 0x7f102c102320 2024-04-06T03:34:46.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10311a3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c102ce0 0x7f102c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10319a4700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f102c102320 0x7f102c198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10319a4700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f102c102320 0x7f102c198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:49002/0 (socket says 172.21.15.47:49002) 2024-04-06T03:34:46.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10311a3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c102ce0 0x7f102c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52064/0 (socket says 172.21.15.47:52064) 2024-04-06T03:34:46.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10319a4700 1 -- 172.21.15.47:0/3827382488 learned_addr learned my addr 172.21.15.47:0/3827382488 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:46.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10321a5700 1 --2- 172.21.15.47:0/3827382488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f102c108300 0x7f102c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10319a4700 1 -- 172.21.15.47:0/3827382488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f102c108300 msgr2=0x7f102c19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10319a4700 1 --2- 172.21.15.47:0/3827382488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f102c108300 0x7f102c19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10319a4700 1 -- 172.21.15.47:0/3827382488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c102ce0 msgr2=0x7f102c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10319a4700 1 --2- 172.21.15.47:0/3827382488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c102ce0 0x7f102c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10319a4700 1 -- 172.21.15.47:0/3827382488 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c19d0f0 con 0x7f102c102320 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.546+0000 7f10311a3700 1 --2- 172.21.15.47:0/3827382488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f102c102ce0 0x7f102c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.547+0000 7f10319a4700 1 --2- 172.21.15.47:0/3827382488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f102c102320 0x7f102c198130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1028006010 tx=0x7f1028003af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.547+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028009e60 con 0x7f102c102320 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.547+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f1028005570 con 0x7f102c102320 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.547+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102c19d380 con 0x7f102c102320 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.547+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102800fdb0 con 0x7f102c102320 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.547+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f102c1a4c60 con 0x7f102c102320 2024-04-06T03:34:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.547+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f102c1078a0 con 0x7f102c102320 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.548+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f1028005050 con 0x7f102c102320 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.549+0000 7f1022ffd700 1 --2- 172.21.15.47:0/3827382488 >> v2:172.21.15.47:6800/3359778320 conn(0x7f101806dc00 0x7f10180700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.549+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f102808eb80 con 0x7f102c102320 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.549+0000 7f10311a3700 1 --2- 172.21.15.47:0/3827382488 >> v2:172.21.15.47:6800/3359778320 conn(0x7f101806dc00 0x7f10180700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.549+0000 7f1022ffd700 1 --2- 172.21.15.47:0/3827382488 >> v2:172.21.15.102:6808/4105297178 conn(0x7f10180774a0 0x7f1018079940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.549+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 --> v2:172.21.15.102:6808/4105297178 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1028010ec0 con 0x7f10180774a0 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.549+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f102808f010 con 0x7f102c102320 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.549+0000 7f10311a3700 1 --2- 172.21.15.47:0/3827382488 >> v2:172.21.15.47:6800/3359778320 conn(0x7f101806dc00 0x7f10180700c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f101c009680 tx=0x7f101c009260 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.549+0000 7f10321a5700 1 --2- 172.21.15.47:0/3827382488 >> v2:172.21.15.102:6808/4105297178 conn(0x7f10180774a0 0x7f1018079940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.550+0000 7f10321a5700 1 --2- 172.21.15.47:0/3827382488 >> v2:172.21.15.102:6808/4105297178 conn(0x7f10180774a0 0x7f1018079940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.550+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 <== osd.6 v2:172.21.15.102:6808/4105297178 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1028010ec0 con 0x7f10180774a0 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.566+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 --> v2:172.21.15.102:6808/4105297178 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f102c1039b0 con 0x7f10180774a0 2024-04-06T03:34:46.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1022ffd700 1 -- 172.21.15.47:0/3827382488 <== osd.6 v2:172.21.15.102:6808/4105297178 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f102c1039b0 con 0x7f10180774a0 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 >> v2:172.21.15.102:6808/4105297178 conn(0x7f10180774a0 msgr2=0x7f1018079940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 --2- 172.21.15.47:0/3827382488 >> v2:172.21.15.102:6808/4105297178 conn(0x7f10180774a0 0x7f1018079940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 >> v2:172.21.15.47:6800/3359778320 conn(0x7f101806dc00 msgr2=0x7f10180700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 --2- 172.21.15.47:0/3827382488 >> v2:172.21.15.47:6800/3359778320 conn(0x7f101806dc00 0x7f10180700c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f101c009680 tx=0x7f101c009260 comp rx=0 tx=0).stop 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f102c102320 msgr2=0x7f102c198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 --2- 172.21.15.47:0/3827382488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f102c102320 0x7f102c198130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1028006010 tx=0x7f1028003af0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f10321a5700 1 -- 172.21.15.47:0/3827382488 reap_dead start 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 shutdown_connections 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 >> 172.21.15.47:0/3827382488 conn(0x7f102c079400 msgr2=0x7f102c105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 shutdown_connections 2024-04-06T03:34:46.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:46.567+0000 7f1033c08700 1 -- 172.21.15.47:0/3827382488 wait complete. 2024-04-06T03:34:46.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 -- 172.21.15.47:0/418883269 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102350 msgr2=0x7fada41027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 --2- 172.21.15.47:0/418883269 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102350 0x7fada41027d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad980098f0 tx=0x7fad98009c00 comp rx=0 tx=0).stop 2024-04-06T03:34:46.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 -- 172.21.15.47:0/418883269 shutdown_connections 2024-04-06T03:34:46.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 --2- 172.21.15.47:0/418883269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada4102d10 0x7fada410f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 --2- 172.21.15.47:0/418883269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada41083a0 0x7fada4108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 --2- 172.21.15.47:0/418883269 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102350 0x7fada41027d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 -- 172.21.15.47:0/418883269 >> 172.21.15.47:0/418883269 conn(0x7fada4079390 msgr2=0x7fada40797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 -- 172.21.15.47:0/418883269 shutdown_connections 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 -- 172.21.15.47:0/418883269 wait complete. 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.900+0000 7fada91a9700 1 Processor -- start 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada91a9700 1 -- start start 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada91a9700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada4102350 0x7fada40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada91a9700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102d10 0x7fada4074b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada91a9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada41083a0 0x7fada4075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada91a9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fada4111c90 con 0x7fada41083a0 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada91a9700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fada4111b10 con 0x7fada4102350 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada91a9700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fada4111e10 con 0x7fada4102d10 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102d10 0x7fada4074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102d10 0x7fada4074b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:58892/0 (socket says 172.21.15.47:58892) 2024-04-06T03:34:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 -- 172.21.15.47:0/4130992179 learned_addr learned my addr 172.21.15.47:0/4130992179 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada359e700 1 --2- 172.21.15.47:0/4130992179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada41083a0 0x7fada4075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada2d9d700 1 --2- 172.21.15.47:0/4130992179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada4102350 0x7fada40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 -- 172.21.15.47:0/4130992179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada4102350 msgr2=0x7fada40745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 --2- 172.21.15.47:0/4130992179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada4102350 0x7fada40745d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 -- 172.21.15.47:0/4130992179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada41083a0 msgr2=0x7fada4075050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 --2- 172.21.15.47:0/4130992179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada41083a0 0x7fada4075050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 -- 172.21.15.47:0/4130992179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada41a66d0 con 0x7fada4102d10 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada2d9d700 1 --2- 172.21.15.47:0/4130992179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada4102350 0x7fada40745d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada359e700 1 --2- 172.21.15.47:0/4130992179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada41083a0 0x7fada4075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.901+0000 7fada259c700 1 --2- 172.21.15.47:0/4130992179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102d10 0x7fada4074b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad9800fb40 tx=0x7fad9800fb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.902+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98027070 con 0x7fada4102d10 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.902+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada41a6960 con 0x7fada4102d10 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.902+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fad9800b560 con 0x7fada4102d10 2024-04-06T03:34:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.902+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98004ac0 con 0x7fada4102d10 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.902+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fada41a6dc0 con 0x7fada4102d10 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.903+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fada4107880 con 0x7fada4102d10 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fad9802a070 con 0x7fada4102d10 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fad8bfff700 1 --2- 172.21.15.47:0/4130992179 >> v2:172.21.15.47:6800/3359778320 conn(0x7fad8c06dc00 0x7fad8c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7fad9808f080 con 0x7fada4102d10 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fada2d9d700 1 --2- 172.21.15.47:0/4130992179 >> v2:172.21.15.47:6800/3359778320 conn(0x7fad8c06dc00 0x7fad8c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fad8bfff700 1 --2- 172.21.15.47:0/4130992179 >> v2:172.21.15.102:6812/3557443636 conn(0x7fad8c0774a0 0x7fad8c079940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 --> v2:172.21.15.102:6812/3557443636 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad98015e50 con 0x7fad8c0774a0 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fad9808f510 con 0x7fada4102d10 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fada2d9d700 1 --2- 172.21.15.47:0/4130992179 >> v2:172.21.15.47:6800/3359778320 conn(0x7fad8c06dc00 0x7fad8c0700c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad94005fd0 tx=0x7fad94005db0 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.904+0000 7fada359e700 1 --2- 172.21.15.47:0/4130992179 >> v2:172.21.15.102:6812/3557443636 conn(0x7fad8c0774a0 0x7fad8c079940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.905+0000 7fada359e700 1 --2- 172.21.15.47:0/4130992179 >> v2:172.21.15.102:6812/3557443636 conn(0x7fad8c0774a0 0x7fad8c079940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:46.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.906+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 <== osd.7 v2:172.21.15.102:6812/3557443636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad98015e50 con 0x7fad8c0774a0 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.922+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 --> v2:172.21.15.102:6812/3557443636 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fada4103a10 con 0x7fad8c0774a0 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.923+0000 7fad8bfff700 1 -- 172.21.15.47:0/4130992179 <== osd.7 v2:172.21.15.102:6812/3557443636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fada4103a10 con 0x7fad8c0774a0 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 >> v2:172.21.15.102:6812/3557443636 conn(0x7fad8c0774a0 msgr2=0x7fad8c079940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 --2- 172.21.15.47:0/4130992179 >> v2:172.21.15.102:6812/3557443636 conn(0x7fad8c0774a0 0x7fad8c079940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 >> v2:172.21.15.47:6800/3359778320 conn(0x7fad8c06dc00 msgr2=0x7fad8c0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 --2- 172.21.15.47:0/4130992179 >> v2:172.21.15.47:6800/3359778320 conn(0x7fad8c06dc00 0x7fad8c0700c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad94005fd0 tx=0x7fad94005db0 comp rx=0 tx=0).stop 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102d10 msgr2=0x7fada4074b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 --2- 172.21.15.47:0/4130992179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fada4102d10 0x7fada4074b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad9800fb40 tx=0x7fad9800fb70 comp rx=0 tx=0).stop 2024-04-06T03:34:46.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada359e700 1 -- 172.21.15.47:0/4130992179 reap_dead start 2024-04-06T03:34:46.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 shutdown_connections 2024-04-06T03:34:46.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 >> 172.21.15.47:0/4130992179 conn(0x7fada4079390 msgr2=0x7fada4105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:46.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 shutdown_connections 2024-04-06T03:34:46.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:45.924+0000 7fada91a9700 1 -- 172.21.15.47:0/4130992179 wait complete. 2024-04-06T03:34:47.373 INFO:teuthology.orchestra.run.smithi047.stdout:231928233999 2024-04-06T03:34:47.373 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.7 2024-04-06T03:34:47.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:47 smithi047 ceph-mon[29365]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:47.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:47 smithi047 ceph-mon[37680]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:48.064 INFO:teuthology.orchestra.run.smithi047.stdout:163208757273 2024-04-06T03:34:48.065 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-04-06T03:34:48.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:47 smithi102 ceph-mon[32821]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:48.854 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:48.862 INFO:teuthology.orchestra.run.smithi047.stdout:197568495637 2024-04-06T03:34:48.862 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.6 2024-04-06T03:34:48.911 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:48.913 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:49.164 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:49.166 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:49 smithi047 ceph-mon[29365]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:49 smithi047 ceph-mon[37680]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:49 smithi102 ceph-mon[32821]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-06T03:34:51.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:51 smithi047 ceph-mon[29365]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:51 smithi047 ceph-mon[37680]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:51.995 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:52.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:34:51 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:34:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:51 smithi102 ceph-mon[32821]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:52.415 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:52 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:52 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:52 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.798+0000 7f70a83e9700 1 -- 172.21.15.47:0/3307834505 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0102ce0 msgr2=0x7f70a010f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.798+0000 7f70a83e9700 1 --2- 172.21.15.47:0/3307834505 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0102ce0 0x7f70a010f120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7098009f90 tx=0x7f709800b330 comp rx=0 tx=0).stop 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 -- 172.21.15.47:0/3307834505 shutdown_connections 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 --2- 172.21.15.47:0/3307834505 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0102ce0 0x7f70a010f120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 --2- 172.21.15.47:0/3307834505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a0108300 0x7f70a01086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 --2- 172.21.15.47:0/3307834505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a0102320 0x7f70a01027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 -- 172.21.15.47:0/3307834505 >> 172.21.15.47:0/3307834505 conn(0x7f70a0079400 msgr2=0x7f70a0079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 -- 172.21.15.47:0/3307834505 shutdown_connections 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 -- 172.21.15.47:0/3307834505 wait complete. 2024-04-06T03:34:53.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 Processor -- start 2024-04-06T03:34:53.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 -- start start 2024-04-06T03:34:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a0102320 0x7f70a0197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a0102ce0 0x7f70a0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0108300 0x7f70a019c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0111c90 con 0x7f70a0102ce0 2024-04-06T03:34:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0111b10 con 0x7f70a0102320 2024-04-06T03:34:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.799+0000 7f70a83e9700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f70a0111e10 con 0x7f70a0108300 2024-04-06T03:34:53.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a0102ce0 0x7f70a0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a0102ce0 0x7f70a0198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52082/0 (socket says 172.21.15.47:52082) 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 -- 172.21.15.47:0/1875892846 learned_addr learned my addr 172.21.15.47:0/1875892846 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a6986700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0108300 0x7f70a019c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a6185700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a0102320 0x7f70a0197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 -- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0108300 msgr2=0x7f70a019c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0108300 0x7f70a019c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 -- 172.21.15.47:0/1875892846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a0102320 msgr2=0x7f70a0197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a0102320 0x7f70a0197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 -- 172.21.15.47:0/1875892846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a019cff0 con 0x7f70a0102ce0 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a6986700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0108300 0x7f70a019c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a5984700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a0102ce0 0x7f70a0198520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f709400d950 tx=0x7f709400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f709f7fe700 1 -- 172.21.15.47:0/1875892846 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7094016070 con 0x7f70a0102ce0 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a019d2e0 con 0x7f70a0102ce0 2024-04-06T03:34:53.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f709f7fe700 1 -- 172.21.15.47:0/1875892846 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f709400fd40 con 0x7f70a0102ce0 2024-04-06T03:34:53.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f709f7fe700 1 -- 172.21.15.47:0/1875892846 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709400e3b0 con 0x7f70a0102ce0 2024-04-06T03:34:53.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.800+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a01a4b60 con 0x7f70a0102ce0 2024-04-06T03:34:53.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.802+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a0068f90 con 0x7f70a0102ce0 2024-04-06T03:34:53.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.802+0000 7f709f7fe700 1 -- 172.21.15.47:0/1875892846 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f7094019070 con 0x7f70a0102ce0 2024-04-06T03:34:53.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.802+0000 7f709f7fe700 1 --2- 172.21.15.47:0/1875892846 >> v2:172.21.15.47:6800/3359778320 conn(0x7f708806dc00 0x7f70880700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:53.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.802+0000 7f709f7fe700 1 -- 172.21.15.47:0/1875892846 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f709408d930 con 0x7f70a0102ce0 2024-04-06T03:34:53.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.803+0000 7f70a6185700 1 --2- 172.21.15.47:0/1875892846 >> v2:172.21.15.47:6800/3359778320 conn(0x7f708806dc00 0x7f70880700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:53.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.803+0000 7f70a6185700 1 --2- 172.21.15.47:0/1875892846 >> v2:172.21.15.47:6800/3359778320 conn(0x7f708806dc00 0x7f70880700c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7090009750 tx=0x7f7090009310 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:53.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:53.808+0000 7f709f7fe700 1 -- 172.21.15.47:0/1875892846 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f709405b490 con 0x7f70a0102ce0 2024-04-06T03:34:53.927 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:53 smithi047 ceph-mon[29365]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:34:53.927 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:34:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:34:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:34:53.928 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:53 smithi047 ceph-mon[37680]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:34:54.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.018+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f70a01a4d90 con 0x7f70a0102ce0 2024-04-06T03:34:54.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.018+0000 7f709f7fe700 1 -- 172.21.15.47:0/1875892846 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f709405eee0 con 0x7f70a0102ce0 2024-04-06T03:34:54.020 INFO:teuthology.orchestra.run.smithi047.stdout:55834574896 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 >> v2:172.21.15.47:6800/3359778320 conn(0x7f708806dc00 msgr2=0x7f70880700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 --2- 172.21.15.47:0/1875892846 >> v2:172.21.15.47:6800/3359778320 conn(0x7f708806dc00 0x7f70880700c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7090009750 tx=0x7f7090009310 comp rx=0 tx=0).stop 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a0102ce0 msgr2=0x7f70a0198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a0102ce0 0x7f70a0198520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f709400d950 tx=0x7f709400dc60 comp rx=0 tx=0).stop 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 shutdown_connections 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 --2- 172.21.15.47:0/1875892846 >> v2:172.21.15.47:6800/3359778320 conn(0x7f708806dc00 0x7f70880700c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f70a0108300 0x7f70a019c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a0102320 0x7f70a0197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 --2- 172.21.15.47:0/1875892846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a0102ce0 0x7f70a0198520 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 >> 172.21.15.47:0/1875892846 conn(0x7f70a0079400 msgr2=0x7f70a0105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 shutdown_connections 2024-04-06T03:34:54.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:54.021+0000 7f70a83e9700 1 -- 172.21.15.47:0/1875892846 wait complete. 2024-04-06T03:34:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:53 smithi102 ceph-mon[32821]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:34:54.662 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574893 got 55834574896 for osd.1 2024-04-06T03:34:54.662 DEBUG:teuthology.parallel:result is None 2024-04-06T03:34:54.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1875892846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-06T03:34:54.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1875892846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-06T03:34:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1875892846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-06T03:34:55.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 -- 172.21.15.47:0/1914565159 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb024101e10 msgr2=0x7fb024105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:55.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 --2- 172.21.15.47:0/1914565159 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb024101e10 0x7fb024105dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0099c0 tx=0x7fb00c009cd0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 -- 172.21.15.47:0/1914565159 shutdown_connections 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 --2- 172.21.15.47:0/1914565159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0241064b0 0x7fb02410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 --2- 172.21.15.47:0/1914565159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024101460 0x7fb024101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 --2- 172.21.15.47:0/1914565159 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb024101e10 0x7fb024105dd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 -- 172.21.15.47:0/1914565159 >> 172.21.15.47:0/1914565159 conn(0x7fb024077220 msgr2=0x7fb024077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 -- 172.21.15.47:0/1914565159 shutdown_connections 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.302+0000 7fb029556700 1 -- 172.21.15.47:0/1914565159 wait complete. 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb029556700 1 Processor -- start 2024-04-06T03:34:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb029556700 1 -- start start 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb029556700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024101460 0x7fb024197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb029556700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb024101e10 0x7fb024197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb029556700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0241064b0 0x7fb02419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb029556700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb024110ba0 con 0x7fb024101e10 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb029556700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb024110a20 con 0x7fb024101460 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb029556700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb024110d20 con 0x7fb0241064b0 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb0227fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb024101e10 0x7fb024197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0241064b0 0x7fb02419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb0227fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb024101e10 0x7fb024197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52106/0 (socket says 172.21.15.47:52106) 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0241064b0 0x7fb02419ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:49048/0 (socket says 172.21.15.47:49048) 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb0227fc700 1 -- 172.21.15.47:0/1160377260 learned_addr learned my addr 172.21.15.47:0/1160377260 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:55.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.303+0000 7fb022ffd700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024101460 0x7fb024197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb0237fe700 1 -- 172.21.15.47:0/1160377260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024101460 msgr2=0x7fb024197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb0237fe700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024101460 0x7fb024197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb0237fe700 1 -- 172.21.15.47:0/1160377260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb024101e10 msgr2=0x7fb024197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb0237fe700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb024101e10 0x7fb024197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb0237fe700 1 -- 172.21.15.47:0/1160377260 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02419c140 con 0x7fb0241064b0 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb0227fc700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb024101e10 0x7fb024197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb022ffd700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024101460 0x7fb024197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb0237fe700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0241064b0 0x7fb02419ba00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb01400e900 tx=0x7fb01400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb01bfff700 1 -- 172.21.15.47:0/1160377260 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01400cbd0 con 0x7fb0241064b0 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02419c430 con 0x7fb0241064b0 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb01bfff700 1 -- 172.21.15.47:0/1160377260 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fb01400ee50 con 0x7fb0241064b0 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb01bfff700 1 -- 172.21.15.47:0/1160377260 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014003d90 con 0x7fb0241064b0 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.304+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0241a3cb0 con 0x7fb0241064b0 2024-04-06T03:34:55.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.305+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb024068f90 con 0x7fb0241064b0 2024-04-06T03:34:55.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.305+0000 7fb01bfff700 1 -- 172.21.15.47:0/1160377260 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fb014018430 con 0x7fb0241064b0 2024-04-06T03:34:55.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.306+0000 7fb01bfff700 1 --2- 172.21.15.47:0/1160377260 >> v2:172.21.15.47:6800/3359778320 conn(0x7fb01006dc00 0x7fb0100700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:55.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.306+0000 7fb01bfff700 1 -- 172.21.15.47:0/1160377260 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7fb01408dc30 con 0x7fb0241064b0 2024-04-06T03:34:55.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.306+0000 7fb022ffd700 1 --2- 172.21.15.47:0/1160377260 >> v2:172.21.15.47:6800/3359778320 conn(0x7fb01006dc00 0x7fb0100700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:55.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.306+0000 7fb022ffd700 1 --2- 172.21.15.47:0/1160377260 >> v2:172.21.15.47:6800/3359778320 conn(0x7fb01006dc00 0x7fb0100700c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009fa0 tx=0x7fb01c009570 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:55.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.311+0000 7fb01bfff700 1 -- 172.21.15.47:0/1160377260 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb01405b710 con 0x7fb0241064b0 2024-04-06T03:34:55.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.518+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb0241a3ee0 con 0x7fb0241064b0 2024-04-06T03:34:55.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.518+0000 7fb01bfff700 1 -- 172.21.15.47:0/1160377260 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb01405f160 con 0x7fb0241064b0 2024-04-06T03:34:55.520 INFO:teuthology.orchestra.run.smithi047.stdout:77309411371 2024-04-06T03:34:55.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 >> v2:172.21.15.47:6800/3359778320 conn(0x7fb01006dc00 msgr2=0x7fb0100700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:55.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 --2- 172.21.15.47:0/1160377260 >> v2:172.21.15.47:6800/3359778320 conn(0x7fb01006dc00 0x7fb0100700c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009fa0 tx=0x7fb01c009570 comp rx=0 tx=0).stop 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0241064b0 msgr2=0x7fb02419ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0241064b0 0x7fb02419ba00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb01400e900 tx=0x7fb01400ec10 comp rx=0 tx=0).stop 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 shutdown_connections 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 --2- 172.21.15.47:0/1160377260 >> v2:172.21.15.47:6800/3359778320 conn(0x7fb01006dc00 0x7fb0100700c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0241064b0 0x7fb02419ba00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024101460 0x7fb024197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 --2- 172.21.15.47:0/1160377260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb024101e10 0x7fb024197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 >> 172.21.15.47:0/1160377260 conn(0x7fb024077220 msgr2=0x7fb0240ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 shutdown_connections 2024-04-06T03:34:55.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:55.520+0000 7fb029556700 1 -- 172.21.15.47:0/1160377260 wait complete. 2024-04-06T03:34:55.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:55 smithi047 ceph-mon[29365]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:55.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1160377260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-06T03:34:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:55 smithi047 ceph-mon[37680]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1160377260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-06T03:34:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:55 smithi102 ceph-mon[32821]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1160377260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-06T03:34:56.894 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411369 got 77309411371 for osd.2 2024-04-06T03:34:56.894 DEBUG:teuthology.parallel:result is None 2024-04-06T03:34:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:56 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:56 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:57.090 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:56 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:57.091 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:56 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:57.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:56 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:57.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:56 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:34:57.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 -- 172.21.15.47:0/1231347081 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406aa70 msgr2=0x7fd39406ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 --2- 172.21.15.47:0/1231347081 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406aa70 0x7fd39406ae50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd3840099c0 tx=0x7fd384009cd0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 -- 172.21.15.47:0/1231347081 shutdown_connections 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 --2- 172.21.15.47:0/1231347081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd394107650 0x7fd39410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 --2- 172.21.15.47:0/1231347081 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406aa70 0x7fd39406ae50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 --2- 172.21.15.47:0/1231347081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39406b420 0x7fd394106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 -- 172.21.15.47:0/1231347081 >> 172.21.15.47:0/1231347081 conn(0x7fd394077220 msgr2=0x7fd394077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 -- 172.21.15.47:0/1231347081 shutdown_connections 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 -- 172.21.15.47:0/1231347081 wait complete. 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.432+0000 7fd398b07700 1 Processor -- start 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd398b07700 1 -- start start 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd398b07700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39406aa70 0x7fd3941012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd398b07700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406b420 0x7fd394101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd398b07700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd394107650 0x7fd394101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd398b07700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111d20 con 0x7fd39406aa70 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd398b07700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111ba0 con 0x7fd394107650 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd398b07700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd394111ea0 con 0x7fd39406b420 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd39259c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39406aa70 0x7fd3941012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd391d9b700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406b420 0x7fd394101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd392d9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd394107650 0x7fd394101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd391d9b700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406b420 0x7fd394101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45562/0 (socket says 172.21.15.47:45562) 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd391d9b700 1 -- 172.21.15.47:0/3680646265 learned_addr learned my addr 172.21.15.47:0/3680646265 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd392d9d700 1 -- 172.21.15.47:0/3680646265 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406b420 msgr2=0x7fd394101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd392d9d700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406b420 0x7fd394101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd392d9d700 1 -- 172.21.15.47:0/3680646265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39406aa70 msgr2=0x7fd3941012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd392d9d700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39406aa70 0x7fd3941012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd392d9d700 1 -- 172.21.15.47:0/3680646265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3941a6790 con 0x7fd394107650 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd391d9b700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406b420 0x7fd394101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.433+0000 7fd39259c700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39406aa70 0x7fd3941012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.434+0000 7fd392d9d700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd394107650 0x7fd394101d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00efc0 tx=0x7fd38c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.434+0000 7fd3837fe700 1 -- 172.21.15.47:0/3680646265 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0092e0 con 0x7fd394107650 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.434+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3941a6a20 con 0x7fd394107650 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.434+0000 7fd3837fe700 1 -- 172.21.15.47:0/3680646265 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd38c004bb0 con 0x7fd394107650 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.434+0000 7fd3837fe700 1 -- 172.21.15.47:0/3680646265 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c004020 con 0x7fd394107650 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.434+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3941a6f60 con 0x7fd394107650 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.435+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd394068f90 con 0x7fd394107650 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.435+0000 7fd3837fe700 1 -- 172.21.15.47:0/3680646265 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fd38c01b030 con 0x7fd394107650 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.436+0000 7fd3837fe700 1 --2- 172.21.15.47:0/3680646265 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd37c06dc00 0x7fd37c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:57.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.436+0000 7fd3837fe700 1 -- 172.21.15.47:0/3680646265 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7fd38c08d660 con 0x7fd394107650 2024-04-06T03:34:57.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.436+0000 7fd39259c700 1 --2- 172.21.15.47:0/3680646265 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd37c06dc00 0x7fd37c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:57.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.436+0000 7fd39259c700 1 --2- 172.21.15.47:0/3680646265 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd37c06dc00 0x7fd37c0700c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd384000c00 tx=0x7fd384005fb0 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:57.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.445+0000 7fd3837fe700 1 -- 172.21.15.47:0/3680646265 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd38c022020 con 0x7fd394107650 2024-04-06T03:34:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.663+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd3941a7130 con 0x7fd394107650 2024-04-06T03:34:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.663+0000 7fd3837fe700 1 -- 172.21.15.47:0/3680646265 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd38c010040 con 0x7fd394107650 2024-04-06T03:34:57.665 INFO:teuthology.orchestra.run.smithi047.stdout:163208757275 2024-04-06T03:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd37c06dc00 msgr2=0x7fd37c0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 --2- 172.21.15.47:0/3680646265 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd37c06dc00 0x7fd37c0700c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd384000c00 tx=0x7fd384005fb0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd394107650 msgr2=0x7fd394101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd394107650 0x7fd394101d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00efc0 tx=0x7fd38c00c3a0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 shutdown_connections 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 --2- 172.21.15.47:0/3680646265 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd37c06dc00 0x7fd37c0700c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd394107650 0x7fd394101d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39406aa70 0x7fd3941012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 --2- 172.21.15.47:0/3680646265 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd39406b420 0x7fd394101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 >> 172.21.15.47:0/3680646265 conn(0x7fd394077220 msgr2=0x7fd3940ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 shutdown_connections 2024-04-06T03:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:57.666+0000 7fd398b07700 1 -- 172.21.15.47:0/3680646265 wait complete. 2024-04-06T03:34:57.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:57 smithi047 ceph-mon[29365]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:57.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3680646265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-06T03:34:57.946 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:57 smithi047 ceph-mon[37680]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:57.946 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3680646265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-06T03:34:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:57 smithi102 ceph-mon[32821]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:34:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3680646265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/3002594375 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d806b580 msgr2=0x7fd8d8106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/3002594375 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d806b580 0x7fd8d8106f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0099c0 tx=0x7fd8cc009cd0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/3002594375 shutdown_connections 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/3002594375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8d8107640 0x7fd8d810f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/3002594375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d806abd0 0x7fd8d806afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/3002594375 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d806b580 0x7fd8d8106f10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/3002594375 >> 172.21.15.47:0/3002594375 conn(0x7fd8d8078140 msgr2=0x7fd8d8078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/3002594375 shutdown_connections 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.383+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/3002594375 wait complete. 2024-04-06T03:34:59.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dfb4b700 1 Processor -- start 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dfb4b700 1 -- start start 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dfb4b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d806abd0 0x7fd8d8101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dfb4b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8d806b580 0x7fd8d81017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dfb4b700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d8107640 0x7fd8d8101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dfb4b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d8111d40 con 0x7fd8d806abd0 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dfb4b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d8111bc0 con 0x7fd8d806b580 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dfb4b700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d8111ec0 con 0x7fd8d8107640 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8de0e8700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d8107640 0x7fd8d8101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dd8e7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d806abd0 0x7fd8d8101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8de0e8700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d8107640 0x7fd8d8101d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45580/0 (socket says 172.21.15.47:45580) 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8de0e8700 1 -- 172.21.15.47:0/1833161118 learned_addr learned my addr 172.21.15.47:0/1833161118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dd8e7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d806abd0 0x7fd8d8101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52174/0 (socket says 172.21.15.47:52174) 2024-04-06T03:34:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.384+0000 7fd8dd0e6700 1 --2- 172.21.15.47:0/1833161118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8d806b580 0x7fd8d81017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8de0e8700 1 -- 172.21.15.47:0/1833161118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8d806b580 msgr2=0x7fd8d81017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8de0e8700 1 --2- 172.21.15.47:0/1833161118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8d806b580 0x7fd8d81017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8de0e8700 1 -- 172.21.15.47:0/1833161118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d806abd0 msgr2=0x7fd8d8101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8de0e8700 1 --2- 172.21.15.47:0/1833161118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d806abd0 0x7fd8d8101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8de0e8700 1 -- 172.21.15.47:0/1833161118 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d81a6740 con 0x7fd8d8107640 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8de0e8700 1 --2- 172.21.15.47:0/1833161118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d8107640 0x7fd8d8101d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800b970 tx=0x7fd8c800bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8d6ffd700 1 -- 172.21.15.47:0/1833161118 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800d860 con 0x7fd8d8107640 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8d6ffd700 1 -- 172.21.15.47:0/1833161118 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd8c800e430 con 0x7fd8d8107640 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d81a6a30 con 0x7fd8d8107640 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8d6ffd700 1 -- 172.21.15.47:0/1833161118 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8017660 con 0x7fd8d8107640 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.385+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d81a6ef0 con 0x7fd8d8107640 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.386+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d81039f0 con 0x7fd8d8107640 2024-04-06T03:34:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.387+0000 7fd8d6ffd700 1 -- 172.21.15.47:0/1833161118 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fd8c800da00 con 0x7fd8d8107640 2024-04-06T03:34:59.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.387+0000 7fd8d6ffd700 1 --2- 172.21.15.47:0/1833161118 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd8c006dc00 0x7fd8c00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:34:59.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.387+0000 7fd8dd8e7700 1 --2- 172.21.15.47:0/1833161118 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd8c006dc00 0x7fd8c00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:34:59.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.387+0000 7fd8d6ffd700 1 -- 172.21.15.47:0/1833161118 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7fd8c808d790 con 0x7fd8d8107640 2024-04-06T03:34:59.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.387+0000 7fd8dd8e7700 1 --2- 172.21.15.47:0/1833161118 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd8c006dc00 0x7fd8c00700c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009680 tx=0x7fd8d0009260 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:34:59.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.392+0000 7fd8d6ffd700 1 -- 172.21.15.47:0/1833161118 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd8c8013030 con 0x7fd8d8107640 2024-04-06T03:34:59.597 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:34:59.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.597+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd8d81a7120 con 0x7fd8d8107640 2024-04-06T03:34:59.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.597+0000 7fd8d6ffd700 1 -- 172.21.15.47:0/1833161118 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd8c805b270 con 0x7fd8d8107640 2024-04-06T03:34:59.599 INFO:teuthology.orchestra.run.smithi047.stdout:128849018912 2024-04-06T03:34:59.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.599+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd8c006dc00 msgr2=0x7fd8c00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.599+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/1833161118 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd8c006dc00 0x7fd8c00700c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009680 tx=0x7fd8d0009260 comp rx=0 tx=0).stop 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.599+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d8107640 msgr2=0x7fd8d8101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.599+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/1833161118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d8107640 0x7fd8d8101d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800b970 tx=0x7fd8c800bc80 comp rx=0 tx=0).stop 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.600+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 shutdown_connections 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.600+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/1833161118 >> v2:172.21.15.47:6800/3359778320 conn(0x7fd8c006dc00 0x7fd8c00700c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.600+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/1833161118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8d8107640 0x7fd8d8101d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.600+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/1833161118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d806abd0 0x7fd8d8101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.600+0000 7fd8dfb4b700 1 --2- 172.21.15.47:0/1833161118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8d806b580 0x7fd8d81017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.600+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 >> 172.21.15.47:0/1833161118 conn(0x7fd8d8078140 msgr2=0x7fd8d80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.600+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 shutdown_connections 2024-04-06T03:34:59.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:34:59.600+0000 7fd8dfb4b700 1 -- 172.21.15.47:0/1833161118 wait complete. 2024-04-06T03:35:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:59 smithi102 ceph-mon[32821]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:34:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1833161118' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-06T03:35:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:59 smithi047 ceph-mon[37680]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:34:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1833161118' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-06T03:35:00.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:59 smithi047 ceph-mon[29365]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:00.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:34:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1833161118' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-06T03:35:00.608 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018908 got 128849018912 for osd.4 2024-04-06T03:35:00.609 DEBUG:teuthology.parallel:result is None 2024-04-06T03:35:00.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:00 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:00.984 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:00 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:00 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:01.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.751+0000 7f3dbf513700 1 -- 172.21.15.47:0/2443927889 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 msgr2=0x7f3db81075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:01.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.751+0000 7f3dbf513700 1 --2- 172.21.15.47:0/2443927889 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 0x7f3db81075f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009990 tx=0x7f3db4009ca0 comp rx=0 tx=0).stop 2024-04-06T03:35:01.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.751+0000 7f3dbf513700 1 -- 172.21.15.47:0/2443927889 shutdown_connections 2024-04-06T03:35:01.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.751+0000 7f3dbf513700 1 --2- 172.21.15.47:0/2443927889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db8101b70 0x7f3db810e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:01.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.751+0000 7f3dbf513700 1 --2- 172.21.15.47:0/2443927889 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 0x7f3db81075f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:01.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 --2- 172.21.15.47:0/2443927889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db81011d0 0x7f3db8101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:01.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 -- 172.21.15.47:0/2443927889 >> 172.21.15.47:0/2443927889 conn(0x7f3db8078100 msgr2=0x7f3db8078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:01.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 -- 172.21.15.47:0/2443927889 shutdown_connections 2024-04-06T03:35:01.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 -- 172.21.15.47:0/2443927889 wait complete. 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 Processor -- start 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 -- start start 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db81011d0 0x7f3db819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db8101b70 0x7f3db819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 0x7f3db819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8110b00 con 0x7f3db8101b70 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8110980 con 0x7f3db81011d0 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.752+0000 7f3dbf513700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f3db8110c80 con 0x7f3db8107210 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbcaae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db8101b70 0x7f3db819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbdab0700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 0x7f3db819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbcaae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db8101b70 0x7f3db819a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52202/0 (socket says 172.21.15.47:52202) 2024-04-06T03:35:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbdab0700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 0x7f3db819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45630/0 (socket says 172.21.15.47:45630) 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbcaae700 1 -- 172.21.15.47:0/3125964111 learned_addr learned my addr 172.21.15.47:0/3125964111 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbd2af700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db81011d0 0x7f3db819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbdab0700 1 -- 172.21.15.47:0/3125964111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db81011d0 msgr2=0x7f3db819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbdab0700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db81011d0 0x7f3db819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbdab0700 1 -- 172.21.15.47:0/3125964111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db8101b70 msgr2=0x7f3db819a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbdab0700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db8101b70 0x7f3db819a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbdab0700 1 -- 172.21.15.47:0/3125964111 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db819f310 con 0x7f3db8107210 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbcaae700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db8101b70 0x7f3db819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbdab0700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 0x7f3db819ebd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3db000efb0 tx=0x7f3db000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dae7fc700 1 -- 172.21.15.47:0/3125964111 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db000ca50 con 0x7f3db8107210 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dae7fc700 1 -- 172.21.15.47:0/3125964111 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f3db000cbf0 con 0x7f3db8107210 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db819f600 con 0x7f3db8107210 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dae7fc700 1 -- 172.21.15.47:0/3125964111 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0004850 con 0x7f3db8107210 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.753+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db81a6e80 con 0x7f3db8107210 2024-04-06T03:35:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.754+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db8068f90 con 0x7f3db8107210 2024-04-06T03:35:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.755+0000 7f3dae7fc700 1 -- 172.21.15.47:0/3125964111 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f3db0012050 con 0x7f3db8107210 2024-04-06T03:35:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.755+0000 7f3dae7fc700 1 --2- 172.21.15.47:0/3125964111 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3da406dc00 0x7f3da40700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.755+0000 7f3dae7fc700 1 -- 172.21.15.47:0/3125964111 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f3db008d410 con 0x7f3db8107210 2024-04-06T03:35:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.755+0000 7f3dbd2af700 1 --2- 172.21.15.47:0/3125964111 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3da406dc00 0x7f3da40700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.756+0000 7f3dbd2af700 1 --2- 172.21.15.47:0/3125964111 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3da406dc00 0x7f3da40700c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3db4006010 tx=0x7f3db401a040 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.760+0000 7f3dae7fc700 1 -- 172.21.15.47:0/3125964111 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3db0022060 con 0x7f3db8107210 2024-04-06T03:35:01.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:01 smithi047 ceph-mon[29365]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:01.816 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:01 smithi047 ceph-mon[37680]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 -- 172.21.15.47:0/3276108491 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f7806b420 msgr2=0x7f8f78106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/3276108491 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f7806b420 0x7f8f78106f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009920 tx=0x7f8f6c009c30 comp rx=0 tx=0).stop 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 -- 172.21.15.47:0/3276108491 shutdown_connections 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/3276108491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f78107650 0x7f8f7810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/3276108491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f7806aa70 0x7f8f7806ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/3276108491 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f7806b420 0x7f8f78106f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 -- 172.21.15.47:0/3276108491 >> 172.21.15.47:0/3276108491 conn(0x7f8f78077220 msgr2=0x7f8f78077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 -- 172.21.15.47:0/3276108491 shutdown_connections 2024-04-06T03:35:02.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.007+0000 7f8f7c98d700 1 -- 172.21.15.47:0/3276108491 wait complete. 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7c98d700 1 Processor -- start 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7c98d700 1 -- start start 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7c98d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f7806aa70 0x7f8f781982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7c98d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f7806b420 0x7f8f781987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7c98d700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f78107650 0x7f8f7819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7c98d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78111cb0 con 0x7f8f7806b420 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7c98d700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78111b30 con 0x7f8f7806aa70 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7c98d700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8f78111e30 con 0x7f8f78107650 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7659c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f7806aa70 0x7f8f781982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7659c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f7806aa70 0x7f8f781982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.47:54394/0 (socket says 172.21.15.47:54394) 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.008+0000 7f8f7659c700 1 -- 172.21.15.47:0/1277423441 learned_addr learned my addr 172.21.15.47:0/1277423441 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f75d9b700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f7806b420 0x7f8f781987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f76d9d700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f78107650 0x7f8f7819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f7659c700 1 -- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f78107650 msgr2=0x7f8f7819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f7659c700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f78107650 0x7f8f7819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f7659c700 1 -- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f7806b420 msgr2=0x7f8f781987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f7659c700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f7806b420 0x7f8f781987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f7659c700 1 -- 172.21.15.47:0/1277423441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7819d2c0 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f76d9d700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f78107650 0x7f8f7819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f7659c700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f7806aa70 0x7f8f781982b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800ec10 tx=0x7f8f6800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.009+0000 7f8f677fe700 1 -- 172.21.15.47:0/1277423441 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800cd40 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.010+0000 7f8f677fe700 1 -- 172.21.15.47:0/1277423441 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f8f680044d0 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.010+0000 7f8f677fe700 1 -- 172.21.15.47:0/1277423441 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68010690 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.010+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7819d5b0 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.010+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f781a4e30 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.010+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f78103a00 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.011+0000 7f8f677fe700 1 -- 172.21.15.47:0/1277423441 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f8f68003e20 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.012+0000 7f8f677fe700 1 --2- 172.21.15.47:0/1277423441 >> v2:172.21.15.47:6800/3359778320 conn(0x7f8f6006dc00 0x7f8f600700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.012+0000 7f8f677fe700 1 -- 172.21.15.47:0/1277423441 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f8f6808e0a0 con 0x7f8f7806aa70 2024-04-06T03:35:02.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.012+0000 7f8f75d9b700 1 --2- 172.21.15.47:0/1277423441 >> v2:172.21.15.47:6800/3359778320 conn(0x7f8f6006dc00 0x7f8f600700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:02.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.012+0000 7f8f75d9b700 1 --2- 172.21.15.47:0/1277423441 >> v2:172.21.15.47:6800/3359778320 conn(0x7f8f6006dc00 0x7f8f600700c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00c010 tx=0x7f8f6c019040 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:02.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.016+0000 7f8f677fe700 1 -- 172.21.15.47:0/1277423441 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8f68053280 con 0x7f8f7806aa70 2024-04-06T03:35:02.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.052+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3db81a70b0 con 0x7f3db8107210 2024-04-06T03:35:02.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.052+0000 7f3dae7fc700 1 -- 172.21.15.47:0/3125964111 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3db0010040 con 0x7f3db8107210 2024-04-06T03:35:02.054 INFO:teuthology.orchestra.run.smithi047.stdout:107374182438 2024-04-06T03:35:02.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.054+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3da406dc00 msgr2=0x7f3da40700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.054+0000 7f3dbf513700 1 --2- 172.21.15.47:0/3125964111 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3da406dc00 0x7f3da40700c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3db4006010 tx=0x7f3db401a040 comp rx=0 tx=0).stop 2024-04-06T03:35:02.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.054+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 msgr2=0x7f3db819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.054+0000 7f3dbf513700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 0x7f3db819ebd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3db000efb0 tx=0x7f3db000c3a0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.055+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 shutdown_connections 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.055+0000 7f3dbf513700 1 --2- 172.21.15.47:0/3125964111 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3da406dc00 0x7f3da40700c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.055+0000 7f3dbf513700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db8107210 0x7f3db819ebd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.055+0000 7f3dbf513700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db81011d0 0x7f3db819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.055+0000 7f3dbf513700 1 --2- 172.21.15.47:0/3125964111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db8101b70 0x7f3db819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.055+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 >> 172.21.15.47:0/3125964111 conn(0x7f3db8078100 msgr2=0x7f3db80ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.055+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 shutdown_connections 2024-04-06T03:35:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.055+0000 7f3dbf513700 1 -- 172.21.15.47:0/3125964111 wait complete. 2024-04-06T03:35:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:01 smithi102 ceph-mon[32821]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:02.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:35:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:35:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.235+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8f781a5000 con 0x7f8f7806aa70 2024-04-06T03:35:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.235+0000 7f8f677fe700 1 -- 172.21.15.47:0/1277423441 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8f68016330 con 0x7f8f7806aa70 2024-04-06T03:35:02.237 INFO:teuthology.orchestra.run.smithi047.stdout:231928234002 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 >> v2:172.21.15.47:6800/3359778320 conn(0x7f8f6006dc00 msgr2=0x7f8f600700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/1277423441 >> v2:172.21.15.47:6800/3359778320 conn(0x7f8f6006dc00 0x7f8f600700c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00c010 tx=0x7f8f6c019040 comp rx=0 tx=0).stop 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f7806aa70 msgr2=0x7f8f781982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f7806aa70 0x7f8f781982b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800ec10 tx=0x7f8f6800ef20 comp rx=0 tx=0).stop 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 shutdown_connections 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/1277423441 >> v2:172.21.15.47:6800/3359778320 conn(0x7f8f6006dc00 0x7f8f600700c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f78107650 0x7f8f7819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f7806aa70 0x7f8f781982b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 --2- 172.21.15.47:0/1277423441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f7806b420 0x7f8f781987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 >> 172.21.15.47:0/1277423441 conn(0x7f8f78077220 msgr2=0x7f8f780ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 shutdown_connections 2024-04-06T03:35:02.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:02.237+0000 7f8f7c98d700 1 -- 172.21.15.47:0/1277423441 wait complete. 2024-04-06T03:35:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 -- 172.21.15.47:0/2707365725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406ac30 msgr2=0x7f155406b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 --2- 172.21.15.47:0/2707365725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406ac30 0x7f155406b010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f154400b0d0 tx=0x7f154400b3e0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 -- 172.21.15.47:0/2707365725 shutdown_connections 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 --2- 172.21.15.47:0/2707365725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1554107650 0x7f155410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 --2- 172.21.15.47:0/2707365725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406ac30 0x7f155406b010 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 --2- 172.21.15.47:0/2707365725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f155406b5e0 0x7f1554106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 -- 172.21.15.47:0/2707365725 >> 172.21.15.47:0/2707365725 conn(0x7f15540771f0 msgr2=0x7f1554077600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 -- 172.21.15.47:0/2707365725 shutdown_connections 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 -- 172.21.15.47:0/2707365725 wait complete. 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.641+0000 7f1559f0f700 1 Processor -- start 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1559f0f700 1 -- start start 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1559f0f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f155406ac30 0x7f15541012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1559f0f700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406b5e0 0x7f1554101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1559f0f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1554107650 0x7f1554101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1559f0f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1554111cb0 con 0x7f1554107650 2024-04-06T03:35:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1559f0f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1554111b30 con 0x7f155406ac30 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1559f0f700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f1554111e30 con 0x7f155406b5e0 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406b5e0 0x7f1554101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406b5e0 0x7f1554101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45608/0 (socket says 172.21.15.47:45608) 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1553fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1554107650 0x7f1554101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 -- 172.21.15.47:0/1394098001 learned_addr learned my addr 172.21.15.47:0/1394098001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f15537fe700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f155406ac30 0x7f15541012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 -- 172.21.15.47:0/1394098001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f155406ac30 msgr2=0x7f15541012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f155406ac30 0x7f15541012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 -- 172.21.15.47:0/1394098001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1554107650 msgr2=0x7f1554101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.702 INFO:teuthology.orchestra.run.smithi047.stdout:34359738421 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1554107650 0x7f1554101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 -- 172.21.15.47:0/1394098001 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15541a66c0 con 0x7f155406b5e0 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1553fff700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1554107650 0x7f1554101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.642+0000 7f1552ffd700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406b5e0 0x7f1554101810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f153c009fd0 tx=0x7f153c00ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.643+0000 7f1550ff9700 1 -- 172.21.15.47:0/1394098001 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c00eea0 con 0x7f155406b5e0 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.643+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15541a69b0 con 0x7f155406b5e0 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.643+0000 7f1550ff9700 1 -- 172.21.15.47:0/1394098001 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f153c0044d0 con 0x7f155406b5e0 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.643+0000 7f1550ff9700 1 -- 172.21.15.47:0/1394098001 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c003d50 con 0x7f155406b5e0 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.643+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15541a6f40 con 0x7f155406b5e0 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.644+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1554103a00 con 0x7f155406b5e0 2024-04-06T03:35:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.644+0000 7f1550ff9700 1 -- 172.21.15.47:0/1394098001 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f153c003f10 con 0x7f155406b5e0 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.645+0000 7f1550ff9700 1 --2- 172.21.15.47:0/1394098001 >> v2:172.21.15.47:6800/3359778320 conn(0x7f154006dc00 0x7f15400700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.645+0000 7f1550ff9700 1 -- 172.21.15.47:0/1394098001 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f153c08dbd0 con 0x7f155406b5e0 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.645+0000 7f15537fe700 1 --2- 172.21.15.47:0/1394098001 >> v2:172.21.15.47:6800/3359778320 conn(0x7f154006dc00 0x7f15400700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.645+0000 7f15537fe700 1 --2- 172.21.15.47:0/1394098001 >> v2:172.21.15.47:6800/3359778320 conn(0x7f154006dc00 0x7f15400700c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1544009fd0 tx=0x7f154400b040 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.650+0000 7f1550ff9700 1 -- 172.21.15.47:0/1394098001 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f153c05b6b0 con 0x7f155406b5e0 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.868+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f15541a7170 con 0x7f155406b5e0 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.868+0000 7f1550ff9700 1 -- 172.21.15.47:0/1394098001 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f153c05f100 con 0x7f155406b5e0 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 >> v2:172.21.15.47:6800/3359778320 conn(0x7f154006dc00 msgr2=0x7f15400700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 --2- 172.21.15.47:0/1394098001 >> v2:172.21.15.47:6800/3359778320 conn(0x7f154006dc00 0x7f15400700c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1544009fd0 tx=0x7f154400b040 comp rx=0 tx=0).stop 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406b5e0 msgr2=0x7f1554101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406b5e0 0x7f1554101810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f153c009fd0 tx=0x7f153c00ed10 comp rx=0 tx=0).stop 2024-04-06T03:35:02.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 shutdown_connections 2024-04-06T03:35:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 --2- 172.21.15.47:0/1394098001 >> v2:172.21.15.47:6800/3359778320 conn(0x7f154006dc00 0x7f15400700c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1554107650 0x7f1554101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f155406ac30 0x7f15541012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 --2- 172.21.15.47:0/1394098001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f155406b5e0 0x7f1554101810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 >> 172.21.15.47:0/1394098001 conn(0x7f15540771f0 msgr2=0x7f15540ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 shutdown_connections 2024-04-06T03:35:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:01.871+0000 7f1559f0f700 1 -- 172.21.15.47:0/1394098001 wait complete. 2024-04-06T03:35:02.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:02.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi047 to 3761M 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1394098001' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3125964111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1277423441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-06T03:35:02.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi047 to 3761M 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:02.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:02.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-06T03:35:02.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:35:02.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1394098001' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-06T03:35:02.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3125964111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-06T03:35:02.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1277423441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-06T03:35:02.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:02.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:03.310 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928233999 got 231928234002 for osd.7 2024-04-06T03:35:03.311 DEBUG:teuthology.parallel:result is None 2024-04-06T03:35:03.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:03.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:03.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:03.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi047 to 3761M 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: Updating smithi102:/etc/ceph/ceph.conf 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1394098001' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3125964111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1277423441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-06T03:35:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:03.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:03.736 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757273 got 163208757275 for osd.5 2024-04-06T03:35:03.736 DEBUG:teuthology.parallel:result is None 2024-04-06T03:35:03.974 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:35:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:35:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:35:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[29365]: Deploying daemon alertmanager.a on smithi047 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:35:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:35:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:35:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:35:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:03 smithi047 ceph-mon[37680]: Deploying daemon alertmanager.a on smithi047 2024-04-06T03:35:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: Updating smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: Updating smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:03 smithi102 ceph-mon[32821]: Deploying daemon alertmanager.a on smithi047 2024-04-06T03:35:04.336 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738418 got 34359738421 for osd.0 2024-04-06T03:35:04.336 DEBUG:teuthology.parallel:result is None 2024-04-06T03:35:05.536 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182435 got 107374182438 for osd.3 2024-04-06T03:35:05.537 DEBUG:teuthology.parallel:result is None 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.002+0000 7fcd533f0700 1 -- 172.21.15.47:0/1168312654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c108300 msgr2=0x7fcd4c1086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.002+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1168312654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c108300 0x7fcd4c1086e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009990 tx=0x7fcd48009ca0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 -- 172.21.15.47:0/1168312654 shutdown_connections 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1168312654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd4c102ce0 0x7fcd4c10f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1168312654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c108300 0x7fcd4c1086e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1168312654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd4c102320 0x7fcd4c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 -- 172.21.15.47:0/1168312654 >> 172.21.15.47:0/1168312654 conn(0x7fcd4c079400 msgr2=0x7fcd4c079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 -- 172.21.15.47:0/1168312654 shutdown_connections 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 -- 172.21.15.47:0/1168312654 wait complete. 2024-04-06T03:35:06.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 Processor -- start 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 -- start start 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c102320 0x7fcd4c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd4c102ce0 0x7fcd4c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd4c108300 0x7fcd4c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c111c40 con 0x7fcd4c108300 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c111ac0 con 0x7fcd4c102ce0 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.003+0000 7fcd533f0700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c111dc0 con 0x7fcd4c102320 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c102320 0x7fcd4c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c102320 0x7fcd4c1980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45678/0 (socket says 172.21.15.47:45678) 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5198d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd4c108300 0x7fcd4c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 -- 172.21.15.47:0/1705426622 learned_addr learned my addr 172.21.15.47:0/1705426622 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5098b700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd4c102ce0 0x7fcd4c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:06.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 -- 172.21.15.47:0/1705426622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd4c102ce0 msgr2=0x7fcd4c198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd4c102ce0 0x7fcd4c198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 -- 172.21.15.47:0/1705426622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd4c108300 msgr2=0x7fcd4c19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd4c108300 0x7fcd4c19c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 -- 172.21.15.47:0/1705426622 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c19d090 con 0x7fcd4c102320 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5198d700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd4c108300 0x7fcd4c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd5118c700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c102320 0x7fcd4c1980d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd480047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd427fc700 1 -- 172.21.15.47:0/1705426622 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48027070 con 0x7fcd4c102320 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd427fc700 1 -- 172.21.15.47:0/1705426622 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fcd48022470 con 0x7fcd4c102320 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c19d320 con 0x7fcd4c102320 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd427fc700 1 -- 172.21.15.47:0/1705426622 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48017650 con 0x7fcd4c102320 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.004+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1a4c00 con 0x7fcd4c102320 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.005+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c1039b0 con 0x7fcd4c102320 2024-04-06T03:35:06.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.006+0000 7fcd427fc700 1 -- 172.21.15.47:0/1705426622 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fcd4802a070 con 0x7fcd4c102320 2024-04-06T03:35:06.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.006+0000 7fcd427fc700 1 --2- 172.21.15.47:0/1705426622 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcd3806dc00 0x7fcd380700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:06.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.006+0000 7fcd427fc700 1 -- 172.21.15.47:0/1705426622 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7fcd4808ebb0 con 0x7fcd4c102320 2024-04-06T03:35:06.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.006+0000 7fcd5098b700 1 --2- 172.21.15.47:0/1705426622 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcd3806dc00 0x7fcd380700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:06.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.006+0000 7fcd5098b700 1 --2- 172.21.15.47:0/1705426622 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcd3806dc00 0x7fcd380700c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009680 tx=0x7fcd3c009260 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:06.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.011+0000 7fcd427fc700 1 -- 172.21.15.47:0/1705426622 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcd48013070 con 0x7fcd4c102320 2024-04-06T03:35:06.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.213+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcd4c1993e0 con 0x7fcd4c102320 2024-04-06T03:35:06.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:05 smithi047 ceph-mon[29365]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:06.215 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:05 smithi047 ceph-mon[37680]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:06.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.213+0000 7fcd427fc700 1 -- 172.21.15.47:0/1705426622 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcd4805c7b0 con 0x7fcd4c102320 2024-04-06T03:35:06.216 INFO:teuthology.orchestra.run.smithi047.stdout:197568495640 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcd3806dc00 msgr2=0x7fcd380700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1705426622 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcd3806dc00 0x7fcd380700c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009680 tx=0x7fcd3c009260 comp rx=0 tx=0).stop 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c102320 msgr2=0x7fcd4c1980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c102320 0x7fcd4c1980d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd480047b0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 shutdown_connections 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1705426622 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcd3806dc00 0x7fcd380700c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd4c108300 0x7fcd4c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcd4c102320 0x7fcd4c1980d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 --2- 172.21.15.47:0/1705426622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd4c102ce0 0x7fcd4c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:06.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 >> 172.21.15.47:0/1705426622 conn(0x7fcd4c079400 msgr2=0x7fcd4c105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:06.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 shutdown_connections 2024-04-06T03:35:06.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:06.215+0000 7fcd533f0700 1 -- 172.21.15.47:0/1705426622 wait complete. 2024-04-06T03:35:06.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:05 smithi102 ceph-mon[32821]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:07.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1705426622' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-06T03:35:07.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1705426622' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-06T03:35:07.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1705426622' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-06T03:35:07.375 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495637 got 197568495640 for osd.6 2024-04-06T03:35:07.375 DEBUG:teuthology.parallel:result is None 2024-04-06T03:35:07.375 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-06T03:35:07.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-06T03:35:07.617 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:35:07.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:07 smithi047 ceph-mon[29365]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:07.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:07 smithi047 ceph-mon[37680]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:08.257 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:07 smithi102 ceph-mon[32821]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:10.213 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:09 smithi047 ceph-mon[37680]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:10.213 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:09 smithi047 ceph-mon[29365]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:10.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:09 smithi102 ceph-mon[32821]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:11.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 -- 172.21.15.47:0/1412137745 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe434107640 msgr2=0x7fe43410f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:11.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/1412137745 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe434107640 0x7fe43410f1c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00b0d0 tx=0x7fe42c00b3e0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 -- 172.21.15.47:0/1412137745 shutdown_connections 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/1412137745 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe434107640 0x7fe43410f1c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/1412137745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43406abd0 0x7fe43406afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/1412137745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe43406b580 0x7fe434106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 -- 172.21.15.47:0/1412137745 >> 172.21.15.47:0/1412137745 conn(0x7fe434078140 msgr2=0x7fe434078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 -- 172.21.15.47:0/1412137745 shutdown_connections 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 -- 172.21.15.47:0/1412137745 wait complete. 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 Processor -- start 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.065+0000 7fe43bcfb700 1 -- start start 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe43bcfb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43406abd0 0x7fe4341981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe43bcfb700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43406b580 0x7fe434198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe43bcfb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe434107640 0x7fe43419ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe43bcfb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe434111ce0 con 0x7fe43406abd0 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe43bcfb700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe434111b60 con 0x7fe434107640 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe43bcfb700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe434111e60 con 0x7fe43406b580 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43406b580 0x7fe434198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439a97700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43406abd0 0x7fe4341981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43406b580 0x7fe434198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:38378/0 (socket says 172.21.15.47:38378) 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 -- 172.21.15.47:0/463895470 learned_addr learned my addr 172.21.15.47:0/463895470 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439a97700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43406abd0 0x7fe4341981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38828/0 (socket says 172.21.15.47:38828) 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe43a298700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe434107640 0x7fe43419ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 -- 172.21.15.47:0/463895470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe434107640 msgr2=0x7fe43419ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe434107640 0x7fe43419ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 -- 172.21.15.47:0/463895470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43406abd0 msgr2=0x7fe4341981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43406abd0 0x7fe4341981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 -- 172.21.15.47:0/463895470 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43419d1a0 con 0x7fe43406b580 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe43a298700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe434107640 0x7fe43419ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439a97700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43406abd0 0x7fe4341981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.066+0000 7fe439296700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43406b580 0x7fe434198720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe43000e940 tx=0x7fe43000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.067+0000 7fe426ffd700 1 -- 172.21.15.47:0/463895470 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43000cbd0 con 0x7fe43406b580 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.067+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43419d490 con 0x7fe43406b580 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.067+0000 7fe426ffd700 1 -- 172.21.15.47:0/463895470 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe43000ee90 con 0x7fe43406b580 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.067+0000 7fe426ffd700 1 -- 172.21.15.47:0/463895470 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe430018680 con 0x7fe43406b580 2024-04-06T03:35:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.067+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4341011c0 con 0x7fe43406b580 2024-04-06T03:35:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.067+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4341039f0 con 0x7fe43406b580 2024-04-06T03:35:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.068+0000 7fe426ffd700 1 -- 172.21.15.47:0/463895470 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fe430010430 con 0x7fe43406b580 2024-04-06T03:35:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.068+0000 7fe426ffd700 1 --2- 172.21.15.47:0/463895470 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe42006dc00 0x7fe4200700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.069+0000 7fe426ffd700 1 -- 172.21.15.47:0/463895470 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7fe43008dd40 con 0x7fe43406b580 2024-04-06T03:35:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.069+0000 7fe439a97700 1 --2- 172.21.15.47:0/463895470 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe42006dc00 0x7fe4200700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.069+0000 7fe439a97700 1 --2- 172.21.15.47:0/463895470 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe42006dc00 0x7fe4200700c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe428009680 tx=0x7fe428009260 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:11.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.073+0000 7fe426ffd700 1 -- 172.21.15.47:0/463895470 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe43005b820 con 0x7fe43406b580 2024-04-06T03:35:11.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.273+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 --> v2:172.21.15.47:6800/3359778320 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4341994f0 con 0x7fe42006dc00 2024-04-06T03:35:11.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.284+0000 7fe426ffd700 1 -- 172.21.15.47:0/463895470 <== mgr.14568 v2:172.21.15.47:6800/3359778320 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346508 (secure 0 0 0) 0x7fe4341994f0 con 0x7fe42006dc00 2024-04-06T03:35:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:35:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.287+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe42006dc00 msgr2=0x7fe4200700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.287+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/463895470 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe42006dc00 0x7fe4200700c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe428009680 tx=0x7fe428009260 comp rx=0 tx=0).stop 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.287+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43406b580 msgr2=0x7fe434198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.287+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43406b580 0x7fe434198720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe43000e940 tx=0x7fe43000ec50 comp rx=0 tx=0).stop 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.288+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 shutdown_connections 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.288+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/463895470 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe42006dc00 0x7fe4200700c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.288+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe434107640 0x7fe43419ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.288+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43406abd0 0x7fe4341981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.288+0000 7fe43bcfb700 1 --2- 172.21.15.47:0/463895470 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43406b580 0x7fe434198720 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.288+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 >> 172.21.15.47:0/463895470 conn(0x7fe434078140 msgr2=0x7fe4340ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.288+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 shutdown_connections 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:11.288+0000 7fe43bcfb700 1 -- 172.21.15.47:0/463895470 wait complete. 2024-04-06T03:35:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-06T03:35:11.880 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-06T03:35:10.333411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596318,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":1292,"num_read_kb":1106,"num_write":807,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1771324,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":796,"ondisk_log_size":796,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":244336,"kb_used_data":7388,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749716880,"statfs":{"total":767960285184,"available":767710085120,"internally_reserved":0,"allocated":7565312,"data_stored":4027914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003099"},"pg_stats":[{"pgid":"6.1a","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315649+0000","last_change":"2024-04-06T03:33:56.707043+0000","last_active":"2024-04-06T03:34:30.315649+0000","last_peered":"2024-04-06T03:34:30.315649+0000","last_clean":"2024-04-06T03:34:30.315649+0000","last_became_active":"2024-04-06T03:33:56.706723+0000","last_became_peered":"2024-04-06T03:33:56.706723+0000","last_unstale":"2024-04-06T03:34:30.315649+0000","last_undegraded":"2024-04-06T03:34:30.315649+0000","last_fullsized":"2024-04-06T03:34:30.315649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:46:19.819209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489111+0000","last_change":"2024-04-06T03:33:54.706783+0000","last_active":"2024-04-06T03:34:30.489111+0000","last_peered":"2024-04-06T03:34:30.489111+0000","last_clean":"2024-04-06T03:34:30.489111+0000","last_became_active":"2024-04-06T03:33:54.706469+0000","last_became_peered":"2024-04-06T03:33:54.706469+0000","last_unstale":"2024-04-06T03:34:30.489111+0000","last_undegraded":"2024-04-06T03:34:30.489111+0000","last_fullsized":"2024-04-06T03:34:30.489111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:41:27.809558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314553+0000","last_change":"2024-04-06T03:33:50.681808+0000","last_active":"2024-04-06T03:34:30.314553+0000","last_peered":"2024-04-06T03:34:30.314553+0000","last_clean":"2024-04-06T03:34:30.314553+0000","last_became_active":"2024-04-06T03:33:50.681425+0000","last_became_peered":"2024-04-06T03:33:50.681425+0000","last_unstale":"2024-04-06T03:34:30.314553+0000","last_undegraded":"2024-04-06T03:34:30.314553+0000","last_fullsized":"2024-04-06T03:34:30.314553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:20:29.105308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"68'15","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315567+0000","last_change":"2024-04-06T03:33:52.693575+0000","last_active":"2024-04-06T03:34:30.315567+0000","last_peered":"2024-04-06T03:34:30.315567+0000","last_clean":"2024-04-06T03:34:30.315567+0000","last_became_active":"2024-04-06T03:33:52.693271+0000","last_became_peered":"2024-04-06T03:33:52.693271+0000","last_unstale":"2024-04-06T03:34:30.315567+0000","last_undegraded":"2024-04-06T03:34:30.315567+0000","last_fullsized":"2024-04-06T03:34:30.315567+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:06:15.175922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488888+0000","last_change":"2024-04-06T03:33:56.834245+0000","last_active":"2024-04-06T03:34:30.488888+0000","last_peered":"2024-04-06T03:34:30.488888+0000","last_clean":"2024-04-06T03:34:30.488888+0000","last_became_active":"2024-04-06T03:33:56.833882+0000","last_became_peered":"2024-04-06T03:33:56.833882+0000","last_unstale":"2024-04-06T03:34:30.488888+0000","last_undegraded":"2024-04-06T03:34:30.488888+0000","last_fullsized":"2024-04-06T03:34:30.488888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:42:35.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315567+0000","last_change":"2024-04-06T03:33:54.704064+0000","last_active":"2024-04-06T03:34:30.315567+0000","last_peered":"2024-04-06T03:34:30.315567+0000","last_clean":"2024-04-06T03:34:30.315567+0000","last_became_active":"2024-04-06T03:33:54.703770+0000","last_became_peered":"2024-04-06T03:33:54.703770+0000","last_unstale":"2024-04-06T03:34:30.315567+0000","last_undegraded":"2024-04-06T03:34:30.315567+0000","last_fullsized":"2024-04-06T03:34:30.315567+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:23:05.128989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490191+0000","last_change":"2024-04-06T03:33:50.695432+0000","last_active":"2024-04-06T03:34:30.490191+0000","last_peered":"2024-04-06T03:34:30.490191+0000","last_clean":"2024-04-06T03:34:30.490191+0000","last_became_active":"2024-04-06T03:33:50.694807+0000","last_became_peered":"2024-04-06T03:33:50.694807+0000","last_unstale":"2024-04-06T03:34:30.490191+0000","last_undegraded":"2024-04-06T03:34:30.490191+0000","last_fullsized":"2024-04-06T03:34:30.490191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:15:55.693519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"68'39","reported_seq":102,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488543+0000","last_change":"2024-04-06T03:33:52.694298+0000","last_active":"2024-04-06T03:34:30.488543+0000","last_peered":"2024-04-06T03:34:30.488543+0000","last_clean":"2024-04-06T03:34:30.488543+0000","last_became_active":"2024-04-06T03:33:52.693950+0000","last_became_peered":"2024-04-06T03:33:52.693950+0000","last_unstale":"2024-04-06T03:34:30.488543+0000","last_undegraded":"2024-04-06T03:34:30.488543+0000","last_fullsized":"2024-04-06T03:34:30.488543+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:36:46.676045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"68'1","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314023+0000","last_change":"2024-04-06T03:33:56.717422+0000","last_active":"2024-04-06T03:34:30.314023+0000","last_peered":"2024-04-06T03:34:30.314023+0000","last_clean":"2024-04-06T03:34:30.314023+0000","last_became_active":"2024-04-06T03:33:56.717109+0000","last_became_peered":"2024-04-06T03:33:56.717109+0000","last_unstale":"2024-04-06T03:34:30.314023+0000","last_undegraded":"2024-04-06T03:34:30.314023+0000","last_fullsized":"2024-04-06T03:34:30.314023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:13:49.521131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411251+0000","last_change":"2024-04-06T03:33:54.707223+0000","last_active":"2024-04-06T03:34:30.411251+0000","last_peered":"2024-04-06T03:34:30.411251+0000","last_clean":"2024-04-06T03:34:30.411251+0000","last_became_active":"2024-04-06T03:33:54.706881+0000","last_became_peered":"2024-04-06T03:33:54.706881+0000","last_unstale":"2024-04-06T03:34:30.411251+0000","last_undegraded":"2024-04-06T03:34:30.411251+0000","last_fullsized":"2024-04-06T03:34:30.411251+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:19:18.573623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411261+0000","last_change":"2024-04-06T03:33:50.688804+0000","last_active":"2024-04-06T03:34:30.411261+0000","last_peered":"2024-04-06T03:34:30.411261+0000","last_clean":"2024-04-06T03:34:30.411261+0000","last_became_active":"2024-04-06T03:33:50.688461+0000","last_became_peered":"2024-04-06T03:33:50.688461+0000","last_unstale":"2024-04-06T03:34:30.411261+0000","last_undegraded":"2024-04-06T03:34:30.411261+0000","last_fullsized":"2024-04-06T03:34:30.411261+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:17:29.971286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"68'23","reported_seq":71,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316031+0000","last_change":"2024-04-06T03:33:52.695910+0000","last_active":"2024-04-06T03:34:30.316031+0000","last_peered":"2024-04-06T03:34:30.316031+0000","last_clean":"2024-04-06T03:34:30.316031+0000","last_became_active":"2024-04-06T03:33:52.694932+0000","last_became_peered":"2024-04-06T03:33:52.694932+0000","last_unstale":"2024-04-06T03:34:30.316031+0000","last_undegraded":"2024-04-06T03:34:30.316031+0000","last_fullsized":"2024-04-06T03:34:30.316031+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:12:01.140912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.410905+0000","last_change":"2024-04-06T03:33:56.710968+0000","last_active":"2024-04-06T03:34:30.410905+0000","last_peered":"2024-04-06T03:34:30.410905+0000","last_clean":"2024-04-06T03:34:30.410905+0000","last_became_active":"2024-04-06T03:33:56.710733+0000","last_became_peered":"2024-04-06T03:33:56.710733+0000","last_unstale":"2024-04-06T03:34:30.410905+0000","last_undegraded":"2024-04-06T03:34:30.410905+0000","last_fullsized":"2024-04-06T03:34:30.410905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:53:04.280768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423484+0000","last_change":"2024-04-06T03:33:54.702936+0000","last_active":"2024-04-06T03:34:30.423484+0000","last_peered":"2024-04-06T03:34:30.423484+0000","last_clean":"2024-04-06T03:34:30.423484+0000","last_became_active":"2024-04-06T03:33:54.702644+0000","last_became_peered":"2024-04-06T03:33:54.702644+0000","last_unstale":"2024-04-06T03:34:30.423484+0000","last_undegraded":"2024-04-06T03:34:30.423484+0000","last_fullsized":"2024-04-06T03:34:30.423484+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:22:24.120594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411318+0000","last_change":"2024-04-06T03:33:50.687481+0000","last_active":"2024-04-06T03:34:30.411318+0000","last_peered":"2024-04-06T03:34:30.411318+0000","last_clean":"2024-04-06T03:34:30.411318+0000","last_became_active":"2024-04-06T03:33:50.687193+0000","last_became_peered":"2024-04-06T03:33:50.687193+0000","last_unstale":"2024-04-06T03:34:30.411318+0000","last_undegraded":"2024-04-06T03:34:30.411318+0000","last_fullsized":"2024-04-06T03:34:30.411318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:52:27.455051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"68'11","reported_seq":51,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316132+0000","last_change":"2024-04-06T03:33:52.696056+0000","last_active":"2024-04-06T03:34:30.316132+0000","last_peered":"2024-04-06T03:34:30.316132+0000","last_clean":"2024-04-06T03:34:30.316132+0000","last_became_active":"2024-04-06T03:33:52.695466+0000","last_became_peered":"2024-04-06T03:33:52.695466+0000","last_unstale":"2024-04-06T03:34:30.316132+0000","last_undegraded":"2024-04-06T03:34:30.316132+0000","last_fullsized":"2024-04-06T03:34:30.316132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:06:39.372389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316367+0000","last_change":"2024-04-06T03:33:56.831915+0000","last_active":"2024-04-06T03:34:30.316367+0000","last_peered":"2024-04-06T03:34:30.316367+0000","last_clean":"2024-04-06T03:34:30.316367+0000","last_became_active":"2024-04-06T03:33:56.831584+0000","last_became_peered":"2024-04-06T03:33:56.831584+0000","last_unstale":"2024-04-06T03:34:30.316367+0000","last_undegraded":"2024-04-06T03:34:30.316367+0000","last_fullsized":"2024-04-06T03:34:30.316367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:49:23.395533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489718+0000","last_change":"2024-04-06T03:33:54.706408+0000","last_active":"2024-04-06T03:34:30.489718+0000","last_peered":"2024-04-06T03:34:30.489718+0000","last_clean":"2024-04-06T03:34:30.489718+0000","last_became_active":"2024-04-06T03:33:54.705825+0000","last_became_peered":"2024-04-06T03:33:54.705825+0000","last_unstale":"2024-04-06T03:34:30.489718+0000","last_undegraded":"2024-04-06T03:34:30.489718+0000","last_fullsized":"2024-04-06T03:34:30.489718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:27:25.796532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314545+0000","last_change":"2024-04-06T03:33:50.693783+0000","last_active":"2024-04-06T03:34:30.314545+0000","last_peered":"2024-04-06T03:34:30.314545+0000","last_clean":"2024-04-06T03:34:30.314545+0000","last_became_active":"2024-04-06T03:33:50.693467+0000","last_became_peered":"2024-04-06T03:33:50.693467+0000","last_unstale":"2024-04-06T03:34:30.314545+0000","last_undegraded":"2024-04-06T03:34:30.314545+0000","last_fullsized":"2024-04-06T03:34:30.314545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:35:51.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"68'15","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315612+0000","last_change":"2024-04-06T03:33:52.690316+0000","last_active":"2024-04-06T03:34:30.315612+0000","last_peered":"2024-04-06T03:34:30.315612+0000","last_clean":"2024-04-06T03:34:30.315612+0000","last_became_active":"2024-04-06T03:33:52.689856+0000","last_became_peered":"2024-04-06T03:33:52.689856+0000","last_unstale":"2024-04-06T03:34:30.315612+0000","last_undegraded":"2024-04-06T03:34:30.315612+0000","last_fullsized":"2024-04-06T03:34:30.315612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T15:10:58.467688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490287+0000","last_change":"2024-04-06T03:33:56.832179+0000","last_active":"2024-04-06T03:34:30.490287+0000","last_peered":"2024-04-06T03:34:30.490287+0000","last_clean":"2024-04-06T03:34:30.490287+0000","last_became_active":"2024-04-06T03:33:56.831783+0000","last_became_peered":"2024-04-06T03:33:56.831783+0000","last_unstale":"2024-04-06T03:34:30.490287+0000","last_undegraded":"2024-04-06T03:34:30.490287+0000","last_fullsized":"2024-04-06T03:34:30.490287+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:11:29.530162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315800+0000","last_change":"2024-04-06T03:33:54.696531+0000","last_active":"2024-04-06T03:34:30.315800+0000","last_peered":"2024-04-06T03:34:30.315800+0000","last_clean":"2024-04-06T03:34:30.315800+0000","last_became_active":"2024-04-06T03:33:54.696252+0000","last_became_peered":"2024-04-06T03:33:54.696252+0000","last_unstale":"2024-04-06T03:34:30.315800+0000","last_undegraded":"2024-04-06T03:34:30.315800+0000","last_fullsized":"2024-04-06T03:34:30.315800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:53:44.647013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316050+0000","last_change":"2024-04-06T03:33:50.687716+0000","last_active":"2024-04-06T03:34:30.316050+0000","last_peered":"2024-04-06T03:34:30.316050+0000","last_clean":"2024-04-06T03:34:30.316050+0000","last_became_active":"2024-04-06T03:33:50.687366+0000","last_became_peered":"2024-04-06T03:33:50.687366+0000","last_unstale":"2024-04-06T03:34:30.316050+0000","last_undegraded":"2024-04-06T03:34:30.316050+0000","last_fullsized":"2024-04-06T03:34:30.316050+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:32:12.686096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"68'18","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489587+0000","last_change":"2024-04-06T03:33:52.701908+0000","last_active":"2024-04-06T03:34:30.489587+0000","last_peered":"2024-04-06T03:34:30.489587+0000","last_clean":"2024-04-06T03:34:30.489587+0000","last_became_active":"2024-04-06T03:33:52.701572+0000","last_became_peered":"2024-04-06T03:33:52.701572+0000","last_unstale":"2024-04-06T03:34:30.489587+0000","last_undegraded":"2024-04-06T03:34:30.489587+0000","last_fullsized":"2024-04-06T03:34:30.489587+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:32:53.378962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"68'1","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423785+0000","last_change":"2024-04-06T03:33:56.712311+0000","last_active":"2024-04-06T03:34:30.423785+0000","last_peered":"2024-04-06T03:34:30.423785+0000","last_clean":"2024-04-06T03:34:30.423785+0000","last_became_active":"2024-04-06T03:33:56.712014+0000","last_became_peered":"2024-04-06T03:33:56.712014+0000","last_unstale":"2024-04-06T03:34:30.423785+0000","last_undegraded":"2024-04-06T03:34:30.423785+0000","last_fullsized":"2024-04-06T03:34:30.423785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:39:42.452288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"68'8","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751856+0000","last_change":"2024-04-06T03:33:54.705290+0000","last_active":"2024-04-06T03:35:00.751856+0000","last_peered":"2024-04-06T03:35:00.751856+0000","last_clean":"2024-04-06T03:35:00.751856+0000","last_became_active":"2024-04-06T03:33:54.704980+0000","last_became_peered":"2024-04-06T03:33:54.704980+0000","last_unstale":"2024-04-06T03:35:00.751856+0000","last_undegraded":"2024-04-06T03:35:00.751856+0000","last_fullsized":"2024-04-06T03:35:00.751856+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:49:17.609957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"61'1","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489211+0000","last_change":"2024-04-06T03:33:50.690939+0000","last_active":"2024-04-06T03:34:30.489211+0000","last_peered":"2024-04-06T03:34:30.489211+0000","last_clean":"2024-04-06T03:34:30.489211+0000","last_became_active":"2024-04-06T03:33:50.690400+0000","last_became_peered":"2024-04-06T03:33:50.690400+0000","last_unstale":"2024-04-06T03:34:30.489211+0000","last_undegraded":"2024-04-06T03:34:30.489211+0000","last_fullsized":"2024-04-06T03:34:30.489211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:55:28.052869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"68'16","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314992+0000","last_change":"2024-04-06T03:33:52.812361+0000","last_active":"2024-04-06T03:34:30.314992+0000","last_peered":"2024-04-06T03:34:30.314992+0000","last_clean":"2024-04-06T03:34:30.314992+0000","last_became_active":"2024-04-06T03:33:52.811941+0000","last_became_peered":"2024-04-06T03:33:52.811941+0000","last_unstale":"2024-04-06T03:34:30.314992+0000","last_undegraded":"2024-04-06T03:34:30.314992+0000","last_fullsized":"2024-04-06T03:34:30.314992+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:04:47.698211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489861+0000","last_change":"2024-04-06T03:33:56.707166+0000","last_active":"2024-04-06T03:34:30.489861+0000","last_peered":"2024-04-06T03:34:30.489861+0000","last_clean":"2024-04-06T03:34:30.489861+0000","last_became_active":"2024-04-06T03:33:56.706547+0000","last_became_peered":"2024-04-06T03:33:56.706547+0000","last_unstale":"2024-04-06T03:34:30.489861+0000","last_undegraded":"2024-04-06T03:34:30.489861+0000","last_fullsized":"2024-04-06T03:34:30.489861+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:09:31.235568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315318+0000","last_change":"2024-04-06T03:33:54.707695+0000","last_active":"2024-04-06T03:34:30.315318+0000","last_peered":"2024-04-06T03:34:30.315318+0000","last_clean":"2024-04-06T03:34:30.315318+0000","last_became_active":"2024-04-06T03:33:54.706736+0000","last_became_peered":"2024-04-06T03:33:54.706736+0000","last_unstale":"2024-04-06T03:34:30.315318+0000","last_undegraded":"2024-04-06T03:34:30.315318+0000","last_fullsized":"2024-04-06T03:34:30.315318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:52:49.229068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488011+0000","last_change":"2024-04-06T03:33:50.690633+0000","last_active":"2024-04-06T03:34:30.488011+0000","last_peered":"2024-04-06T03:34:30.488011+0000","last_clean":"2024-04-06T03:34:30.488011+0000","last_became_active":"2024-04-06T03:33:50.690329+0000","last_became_peered":"2024-04-06T03:33:50.690329+0000","last_unstale":"2024-04-06T03:34:30.488011+0000","last_undegraded":"2024-04-06T03:34:30.488011+0000","last_fullsized":"2024-04-06T03:34:30.488011+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:35:36.798953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"68'17","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488161+0000","last_change":"2024-04-06T03:33:52.699151+0000","last_active":"2024-04-06T03:34:30.488161+0000","last_peered":"2024-04-06T03:34:30.488161+0000","last_clean":"2024-04-06T03:34:30.488161+0000","last_became_active":"2024-04-06T03:33:52.698798+0000","last_became_peered":"2024-04-06T03:33:52.698798+0000","last_unstale":"2024-04-06T03:34:30.488161+0000","last_undegraded":"2024-04-06T03:34:30.488161+0000","last_fullsized":"2024-04-06T03:34:30.488161+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:36:59.218824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423468+0000","last_change":"2024-04-06T03:33:56.709223+0000","last_active":"2024-04-06T03:34:30.423468+0000","last_peered":"2024-04-06T03:34:30.423468+0000","last_clean":"2024-04-06T03:34:30.423468+0000","last_became_active":"2024-04-06T03:33:56.708907+0000","last_became_peered":"2024-04-06T03:33:56.708907+0000","last_unstale":"2024-04-06T03:34:30.423468+0000","last_undegraded":"2024-04-06T03:34:30.423468+0000","last_fullsized":"2024-04-06T03:34:30.423468+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:35:59.220196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.487725+0000","last_change":"2024-04-06T03:33:54.703438+0000","last_active":"2024-04-06T03:34:30.487725+0000","last_peered":"2024-04-06T03:34:30.487725+0000","last_clean":"2024-04-06T03:34:30.487725+0000","last_became_active":"2024-04-06T03:33:54.703133+0000","last_became_peered":"2024-04-06T03:33:54.703133+0000","last_unstale":"2024-04-06T03:34:30.487725+0000","last_undegraded":"2024-04-06T03:34:30.487725+0000","last_fullsized":"2024-04-06T03:34:30.487725+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:38:50.812962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314642+0000","last_change":"2024-04-06T03:33:50.686802+0000","last_active":"2024-04-06T03:34:30.314642+0000","last_peered":"2024-04-06T03:34:30.314642+0000","last_clean":"2024-04-06T03:34:30.314642+0000","last_became_active":"2024-04-06T03:33:50.686491+0000","last_became_peered":"2024-04-06T03:33:50.686491+0000","last_unstale":"2024-04-06T03:34:30.314642+0000","last_undegraded":"2024-04-06T03:34:30.314642+0000","last_fullsized":"2024-04-06T03:34:30.314642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:07:17.087039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"68'4","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488108+0000","last_change":"2024-04-06T03:33:52.701012+0000","last_active":"2024-04-06T03:34:30.488108+0000","last_peered":"2024-04-06T03:34:30.488108+0000","last_clean":"2024-04-06T03:34:30.488108+0000","last_became_active":"2024-04-06T03:33:52.700641+0000","last_became_peered":"2024-04-06T03:33:52.700641+0000","last_unstale":"2024-04-06T03:34:30.488108+0000","last_undegraded":"2024-04-06T03:34:30.488108+0000","last_fullsized":"2024-04-06T03:34:30.488108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:38:47.810393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488296+0000","last_change":"2024-04-06T03:33:56.832979+0000","last_active":"2024-04-06T03:34:30.488296+0000","last_peered":"2024-04-06T03:34:30.488296+0000","last_clean":"2024-04-06T03:34:30.488296+0000","last_became_active":"2024-04-06T03:33:56.831811+0000","last_became_peered":"2024-04-06T03:33:56.831811+0000","last_unstale":"2024-04-06T03:34:30.488296+0000","last_undegraded":"2024-04-06T03:34:30.488296+0000","last_fullsized":"2024-04-06T03:34:30.488296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:08:12.652208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423868+0000","last_change":"2024-04-06T03:33:54.703553+0000","last_active":"2024-04-06T03:34:30.423868+0000","last_peered":"2024-04-06T03:34:30.423868+0000","last_clean":"2024-04-06T03:34:30.423868+0000","last_became_active":"2024-04-06T03:33:54.703280+0000","last_became_peered":"2024-04-06T03:33:54.703280+0000","last_unstale":"2024-04-06T03:34:30.423868+0000","last_undegraded":"2024-04-06T03:34:30.423868+0000","last_fullsized":"2024-04-06T03:34:30.423868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:24:11.100343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411405+0000","last_change":"2024-04-06T03:33:50.691267+0000","last_active":"2024-04-06T03:34:30.411405+0000","last_peered":"2024-04-06T03:34:30.411405+0000","last_clean":"2024-04-06T03:34:30.411405+0000","last_became_active":"2024-04-06T03:33:50.690933+0000","last_became_peered":"2024-04-06T03:33:50.690933+0000","last_unstale":"2024-04-06T03:34:30.411405+0000","last_undegraded":"2024-04-06T03:34:30.411405+0000","last_fullsized":"2024-04-06T03:34:30.411405+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:04:00.021914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"68'17","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488399+0000","last_change":"2024-04-06T03:33:52.811275+0000","last_active":"2024-04-06T03:34:30.488399+0000","last_peered":"2024-04-06T03:34:30.488399+0000","last_clean":"2024-04-06T03:34:30.488399+0000","last_became_active":"2024-04-06T03:33:52.810900+0000","last_became_peered":"2024-04-06T03:33:52.810900+0000","last_unstale":"2024-04-06T03:34:30.488399+0000","last_undegraded":"2024-04-06T03:34:30.488399+0000","last_fullsized":"2024-04-06T03:34:30.488399+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:41:48.352142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.313715+0000","last_change":"2024-04-06T03:33:56.719670+0000","last_active":"2024-04-06T03:34:30.313715+0000","last_peered":"2024-04-06T03:34:30.313715+0000","last_clean":"2024-04-06T03:34:30.313715+0000","last_became_active":"2024-04-06T03:33:56.719282+0000","last_became_peered":"2024-04-06T03:33:56.719282+0000","last_unstale":"2024-04-06T03:34:30.313715+0000","last_undegraded":"2024-04-06T03:34:30.313715+0000","last_fullsized":"2024-04-06T03:34:30.313715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:41:21.590574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488994+0000","last_change":"2024-04-06T03:33:54.702257+0000","last_active":"2024-04-06T03:34:30.488994+0000","last_peered":"2024-04-06T03:34:30.488994+0000","last_clean":"2024-04-06T03:34:30.488994+0000","last_became_active":"2024-04-06T03:33:54.701857+0000","last_became_peered":"2024-04-06T03:33:54.701857+0000","last_unstale":"2024-04-06T03:34:30.488994+0000","last_undegraded":"2024-04-06T03:34:30.488994+0000","last_fullsized":"2024-04-06T03:34:30.488994+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:16:05.548433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424009+0000","last_change":"2024-04-06T03:33:50.697840+0000","last_active":"2024-04-06T03:34:30.424009+0000","last_peered":"2024-04-06T03:34:30.424009+0000","last_clean":"2024-04-06T03:34:30.424009+0000","last_became_active":"2024-04-06T03:33:50.697552+0000","last_became_peered":"2024-04-06T03:33:50.697552+0000","last_unstale":"2024-04-06T03:34:30.424009+0000","last_undegraded":"2024-04-06T03:34:30.424009+0000","last_fullsized":"2024-04-06T03:34:30.424009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:54:19.540225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"68'9","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.410917+0000","last_change":"2024-04-06T03:34:15.538250+0000","last_active":"2024-04-06T03:34:30.410917+0000","last_peered":"2024-04-06T03:34:30.410917+0000","last_clean":"2024-04-06T03:34:30.410917+0000","last_became_active":"2024-04-06T03:34:15.527665+0000","last_became_peered":"2024-04-06T03:34:15.527665+0000","last_unstale":"2024-04-06T03:34:30.410917+0000","last_undegraded":"2024-04-06T03:34:30.410917+0000","last_fullsized":"2024-04-06T03:34:30.410917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:15:58.337684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488000+0000","last_change":"2024-04-06T03:33:56.716750+0000","last_active":"2024-04-06T03:34:30.488000+0000","last_peered":"2024-04-06T03:34:30.488000+0000","last_clean":"2024-04-06T03:34:30.488000+0000","last_became_active":"2024-04-06T03:33:56.716370+0000","last_became_peered":"2024-04-06T03:33:56.716370+0000","last_unstale":"2024-04-06T03:34:30.488000+0000","last_undegraded":"2024-04-06T03:34:30.488000+0000","last_fullsized":"2024-04-06T03:34:30.488000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:26:25.400348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488459+0000","last_change":"2024-04-06T03:33:54.706600+0000","last_active":"2024-04-06T03:34:30.488459+0000","last_peered":"2024-04-06T03:34:30.488459+0000","last_clean":"2024-04-06T03:34:30.488459+0000","last_became_active":"2024-04-06T03:33:54.706295+0000","last_became_peered":"2024-04-06T03:33:54.706295+0000","last_unstale":"2024-04-06T03:34:30.488459+0000","last_undegraded":"2024-04-06T03:34:30.488459+0000","last_fullsized":"2024-04-06T03:34:30.488459+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:28:02.387377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316086+0000","last_change":"2024-04-06T03:33:50.696057+0000","last_active":"2024-04-06T03:34:30.316086+0000","last_peered":"2024-04-06T03:34:30.316086+0000","last_clean":"2024-04-06T03:34:30.316086+0000","last_became_active":"2024-04-06T03:33:50.694571+0000","last_became_peered":"2024-04-06T03:33:50.694571+0000","last_unstale":"2024-04-06T03:34:30.316086+0000","last_undegraded":"2024-04-06T03:34:30.316086+0000","last_fullsized":"2024-04-06T03:34:30.316086+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:40:18.500106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315961+0000","last_change":"2024-04-06T03:33:52.694209+0000","last_active":"2024-04-06T03:34:30.315961+0000","last_peered":"2024-04-06T03:34:30.315961+0000","last_clean":"2024-04-06T03:34:30.315961+0000","last_became_active":"2024-04-06T03:33:52.693751+0000","last_became_peered":"2024-04-06T03:33:52.693751+0000","last_unstale":"2024-04-06T03:34:30.315961+0000","last_undegraded":"2024-04-06T03:34:30.315961+0000","last_fullsized":"2024-04-06T03:34:30.315961+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:10:24.228571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314737+0000","last_change":"2024-04-06T03:33:56.719009+0000","last_active":"2024-04-06T03:34:30.314737+0000","last_peered":"2024-04-06T03:34:30.314737+0000","last_clean":"2024-04-06T03:34:30.314737+0000","last_became_active":"2024-04-06T03:33:56.718656+0000","last_became_peered":"2024-04-06T03:33:56.718656+0000","last_unstale":"2024-04-06T03:34:30.314737+0000","last_undegraded":"2024-04-06T03:34:30.314737+0000","last_fullsized":"2024-04-06T03:34:30.314737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:29:20.374916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751859+0000","last_change":"2024-04-06T03:33:54.707513+0000","last_active":"2024-04-06T03:35:00.751859+0000","last_peered":"2024-04-06T03:35:00.751859+0000","last_clean":"2024-04-06T03:35:00.751859+0000","last_became_active":"2024-04-06T03:33:54.707056+0000","last_became_peered":"2024-04-06T03:33:54.707056+0000","last_unstale":"2024-04-06T03:35:00.751859+0000","last_undegraded":"2024-04-06T03:35:00.751859+0000","last_fullsized":"2024-04-06T03:35:00.751859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:47:01.921014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423535+0000","last_change":"2024-04-06T03:33:50.697394+0000","last_active":"2024-04-06T03:34:30.423535+0000","last_peered":"2024-04-06T03:34:30.423535+0000","last_clean":"2024-04-06T03:34:30.423535+0000","last_became_active":"2024-04-06T03:33:50.695010+0000","last_became_peered":"2024-04-06T03:33:50.695010+0000","last_unstale":"2024-04-06T03:34:30.423535+0000","last_undegraded":"2024-04-06T03:34:30.423535+0000","last_fullsized":"2024-04-06T03:34:30.423535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:26:00.280020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"68'22","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489420+0000","last_change":"2024-04-06T03:33:52.813042+0000","last_active":"2024-04-06T03:34:30.489420+0000","last_peered":"2024-04-06T03:34:30.489420+0000","last_clean":"2024-04-06T03:34:30.489420+0000","last_became_active":"2024-04-06T03:33:52.812731+0000","last_became_peered":"2024-04-06T03:33:52.812731+0000","last_unstale":"2024-04-06T03:34:30.489420+0000","last_undegraded":"2024-04-06T03:34:30.489420+0000","last_fullsized":"2024-04-06T03:34:30.489420+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:19:19.379905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316424+0000","last_change":"2024-04-06T03:33:56.709408+0000","last_active":"2024-04-06T03:34:30.316424+0000","last_peered":"2024-04-06T03:34:30.316424+0000","last_clean":"2024-04-06T03:34:30.316424+0000","last_became_active":"2024-04-06T03:33:56.708897+0000","last_became_peered":"2024-04-06T03:33:56.708897+0000","last_unstale":"2024-04-06T03:34:30.316424+0000","last_undegraded":"2024-04-06T03:34:30.316424+0000","last_fullsized":"2024-04-06T03:34:30.316424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:53:42.330731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751826+0000","last_change":"2024-04-06T03:33:54.699217+0000","last_active":"2024-04-06T03:35:00.751826+0000","last_peered":"2024-04-06T03:35:00.751826+0000","last_clean":"2024-04-06T03:35:00.751826+0000","last_became_active":"2024-04-06T03:33:54.698895+0000","last_became_peered":"2024-04-06T03:33:54.698895+0000","last_unstale":"2024-04-06T03:35:00.751826+0000","last_undegraded":"2024-04-06T03:35:00.751826+0000","last_fullsized":"2024-04-06T03:35:00.751826+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:49:13.427082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314176+0000","last_change":"2024-04-06T03:33:50.686804+0000","last_active":"2024-04-06T03:34:30.314176+0000","last_peered":"2024-04-06T03:34:30.314176+0000","last_clean":"2024-04-06T03:34:30.314176+0000","last_became_active":"2024-04-06T03:33:50.686520+0000","last_became_peered":"2024-04-06T03:33:50.686520+0000","last_unstale":"2024-04-06T03:34:30.314176+0000","last_undegraded":"2024-04-06T03:34:30.314176+0000","last_fullsized":"2024-04-06T03:34:30.314176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:36:28.245700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"68'15","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411593+0000","last_change":"2024-04-06T03:33:52.813015+0000","last_active":"2024-04-06T03:34:30.411593+0000","last_peered":"2024-04-06T03:34:30.411593+0000","last_clean":"2024-04-06T03:34:30.411593+0000","last_became_active":"2024-04-06T03:33:52.812103+0000","last_became_peered":"2024-04-06T03:33:52.812103+0000","last_unstale":"2024-04-06T03:34:30.411593+0000","last_undegraded":"2024-04-06T03:34:30.411593+0000","last_fullsized":"2024-04-06T03:34:30.411593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:33:15.715979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315868+0000","last_change":"2024-04-06T03:33:56.709011+0000","last_active":"2024-04-06T03:34:30.315868+0000","last_peered":"2024-04-06T03:34:30.315868+0000","last_clean":"2024-04-06T03:34:30.315868+0000","last_became_active":"2024-04-06T03:33:56.708676+0000","last_became_peered":"2024-04-06T03:33:56.708676+0000","last_unstale":"2024-04-06T03:34:30.315868+0000","last_undegraded":"2024-04-06T03:34:30.315868+0000","last_fullsized":"2024-04-06T03:34:30.315868+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:45:25.810089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490604+0000","last_change":"2024-04-06T03:33:54.700486+0000","last_active":"2024-04-06T03:34:30.490604+0000","last_peered":"2024-04-06T03:34:30.490604+0000","last_clean":"2024-04-06T03:34:30.490604+0000","last_became_active":"2024-04-06T03:33:54.700152+0000","last_became_peered":"2024-04-06T03:33:54.700152+0000","last_unstale":"2024-04-06T03:34:30.490604+0000","last_undegraded":"2024-04-06T03:34:30.490604+0000","last_fullsized":"2024-04-06T03:34:30.490604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:46:15.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423669+0000","last_change":"2024-04-06T03:33:50.696815+0000","last_active":"2024-04-06T03:34:30.423669+0000","last_peered":"2024-04-06T03:34:30.423669+0000","last_clean":"2024-04-06T03:34:30.423669+0000","last_became_active":"2024-04-06T03:33:50.695674+0000","last_became_peered":"2024-04-06T03:33:50.695674+0000","last_unstale":"2024-04-06T03:34:30.423669+0000","last_undegraded":"2024-04-06T03:34:30.423669+0000","last_fullsized":"2024-04-06T03:34:30.423669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:19:37.186435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"68'21","reported_seq":69,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315126+0000","last_change":"2024-04-06T03:33:52.811341+0000","last_active":"2024-04-06T03:34:30.315126+0000","last_peered":"2024-04-06T03:34:30.315126+0000","last_clean":"2024-04-06T03:34:30.315126+0000","last_became_active":"2024-04-06T03:33:52.810669+0000","last_became_peered":"2024-04-06T03:33:52.810669+0000","last_unstale":"2024-04-06T03:34:30.315126+0000","last_undegraded":"2024-04-06T03:34:30.315126+0000","last_fullsized":"2024-04-06T03:34:30.315126+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:43:40.070911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423980+0000","last_change":"2024-04-06T03:33:56.834351+0000","last_active":"2024-04-06T03:34:30.423980+0000","last_peered":"2024-04-06T03:34:30.423980+0000","last_clean":"2024-04-06T03:34:30.423980+0000","last_became_active":"2024-04-06T03:33:56.834074+0000","last_became_peered":"2024-04-06T03:33:56.834074+0000","last_unstale":"2024-04-06T03:34:30.423980+0000","last_undegraded":"2024-04-06T03:34:30.423980+0000","last_fullsized":"2024-04-06T03:34:30.423980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:18:47.113001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411517+0000","last_change":"2024-04-06T03:33:54.701666+0000","last_active":"2024-04-06T03:34:30.411517+0000","last_peered":"2024-04-06T03:34:30.411517+0000","last_clean":"2024-04-06T03:34:30.411517+0000","last_became_active":"2024-04-06T03:33:54.701372+0000","last_became_peered":"2024-04-06T03:33:54.701372+0000","last_unstale":"2024-04-06T03:34:30.411517+0000","last_undegraded":"2024-04-06T03:34:30.411517+0000","last_fullsized":"2024-04-06T03:34:30.411517+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:34:04.753694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.487675+0000","last_change":"2024-04-06T03:33:50.687441+0000","last_active":"2024-04-06T03:34:30.487675+0000","last_peered":"2024-04-06T03:34:30.487675+0000","last_clean":"2024-04-06T03:34:30.487675+0000","last_became_active":"2024-04-06T03:33:50.687103+0000","last_became_peered":"2024-04-06T03:33:50.687103+0000","last_unstale":"2024-04-06T03:34:30.487675+0000","last_undegraded":"2024-04-06T03:34:30.487675+0000","last_fullsized":"2024-04-06T03:34:30.487675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:48:29.737672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"68'12","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490685+0000","last_change":"2024-04-06T03:34:15.533918+0000","last_active":"2024-04-06T03:34:30.490685+0000","last_peered":"2024-04-06T03:34:30.490685+0000","last_clean":"2024-04-06T03:34:30.490685+0000","last_became_active":"2024-04-06T03:34:15.527207+0000","last_became_peered":"2024-04-06T03:34:15.527207+0000","last_unstale":"2024-04-06T03:34:30.490685+0000","last_undegraded":"2024-04-06T03:34:30.490685+0000","last_fullsized":"2024-04-06T03:34:30.490685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:22:56.392590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411445+0000","last_change":"2024-04-06T03:33:56.834787+0000","last_active":"2024-04-06T03:34:30.411445+0000","last_peered":"2024-04-06T03:34:30.411445+0000","last_clean":"2024-04-06T03:34:30.411445+0000","last_became_active":"2024-04-06T03:33:56.833620+0000","last_became_peered":"2024-04-06T03:33:56.833620+0000","last_unstale":"2024-04-06T03:34:30.411445+0000","last_undegraded":"2024-04-06T03:34:30.411445+0000","last_fullsized":"2024-04-06T03:34:30.411445+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:45:21.868767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"61'3","reported_seq":51,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424269+0000","last_change":"2024-04-06T03:33:50.700751+0000","last_active":"2024-04-06T03:34:30.424269+0000","last_peered":"2024-04-06T03:34:30.424269+0000","last_clean":"2024-04-06T03:34:30.424269+0000","last_became_active":"2024-04-06T03:33:50.700284+0000","last_became_peered":"2024-04-06T03:33:50.700284+0000","last_unstale":"2024-04-06T03:34:30.424269+0000","last_undegraded":"2024-04-06T03:34:30.424269+0000","last_fullsized":"2024-04-06T03:34:30.424269+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:21:59.195138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"68'27","reported_seq":78,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.410981+0000","last_change":"2024-04-06T03:33:52.812506+0000","last_active":"2024-04-06T03:34:30.410981+0000","last_peered":"2024-04-06T03:34:30.410981+0000","last_clean":"2024-04-06T03:34:30.410981+0000","last_became_active":"2024-04-06T03:33:52.812142+0000","last_became_peered":"2024-04-06T03:33:52.812142+0000","last_unstale":"2024-04-06T03:34:30.410981+0000","last_undegraded":"2024-04-06T03:34:30.410981+0000","last_fullsized":"2024-04-06T03:34:30.410981+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:37:36.172427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.752181+0000","last_change":"2024-04-06T03:33:54.708321+0000","last_active":"2024-04-06T03:35:00.752181+0000","last_peered":"2024-04-06T03:35:00.752181+0000","last_clean":"2024-04-06T03:35:00.752181+0000","last_became_active":"2024-04-06T03:33:54.707596+0000","last_became_peered":"2024-04-06T03:33:54.707596+0000","last_unstale":"2024-04-06T03:35:00.752181+0000","last_undegraded":"2024-04-06T03:35:00.752181+0000","last_fullsized":"2024-04-06T03:35:00.752181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:25:31.957077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488776+0000","last_change":"2024-04-06T03:33:56.718541+0000","last_active":"2024-04-06T03:34:30.488776+0000","last_peered":"2024-04-06T03:34:30.488776+0000","last_clean":"2024-04-06T03:34:30.488776+0000","last_became_active":"2024-04-06T03:33:56.717781+0000","last_became_peered":"2024-04-06T03:33:56.717781+0000","last_unstale":"2024-04-06T03:34:30.488776+0000","last_undegraded":"2024-04-06T03:34:30.488776+0000","last_fullsized":"2024-04-06T03:34:30.488776+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:42:17.900976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424181+0000","last_change":"2024-04-06T03:33:50.700542+0000","last_active":"2024-04-06T03:34:30.424181+0000","last_peered":"2024-04-06T03:34:30.424181+0000","last_clean":"2024-04-06T03:34:30.424181+0000","last_became_active":"2024-04-06T03:33:50.700196+0000","last_became_peered":"2024-04-06T03:33:50.700196+0000","last_unstale":"2024-04-06T03:34:30.424181+0000","last_undegraded":"2024-04-06T03:34:30.424181+0000","last_fullsized":"2024-04-06T03:34:30.424181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:00:31.246266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"68'24","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316209+0000","last_change":"2024-04-06T03:33:52.693101+0000","last_active":"2024-04-06T03:34:30.316209+0000","last_peered":"2024-04-06T03:34:30.316209+0000","last_clean":"2024-04-06T03:34:30.316209+0000","last_became_active":"2024-04-06T03:33:52.692718+0000","last_became_peered":"2024-04-06T03:33:52.692718+0000","last_unstale":"2024-04-06T03:34:30.316209+0000","last_undegraded":"2024-04-06T03:34:30.316209+0000","last_fullsized":"2024-04-06T03:34:30.316209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:00:00.924683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315111+0000","last_change":"2024-04-06T03:33:54.703306+0000","last_active":"2024-04-06T03:34:30.315111+0000","last_peered":"2024-04-06T03:34:30.315111+0000","last_clean":"2024-04-06T03:34:30.315111+0000","last_became_active":"2024-04-06T03:33:54.702945+0000","last_became_peered":"2024-04-06T03:33:54.702945+0000","last_unstale":"2024-04-06T03:34:30.315111+0000","last_undegraded":"2024-04-06T03:34:30.315111+0000","last_fullsized":"2024-04-06T03:34:30.315111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:45:44.332223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423357+0000","last_change":"2024-04-06T03:33:56.714951+0000","last_active":"2024-04-06T03:34:30.423357+0000","last_peered":"2024-04-06T03:34:30.423357+0000","last_clean":"2024-04-06T03:34:30.423357+0000","last_became_active":"2024-04-06T03:33:56.714419+0000","last_became_peered":"2024-04-06T03:33:56.714419+0000","last_unstale":"2024-04-06T03:34:30.423357+0000","last_undegraded":"2024-04-06T03:34:30.423357+0000","last_fullsized":"2024-04-06T03:34:30.423357+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:24:56.597155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315451+0000","last_change":"2024-04-06T03:33:54.703884+0000","last_active":"2024-04-06T03:34:30.315451+0000","last_peered":"2024-04-06T03:34:30.315451+0000","last_clean":"2024-04-06T03:34:30.315451+0000","last_became_active":"2024-04-06T03:33:54.703556+0000","last_became_peered":"2024-04-06T03:33:54.703556+0000","last_unstale":"2024-04-06T03:34:30.315451+0000","last_undegraded":"2024-04-06T03:34:30.315451+0000","last_fullsized":"2024-04-06T03:34:30.315451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:12:07.984217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424107+0000","last_change":"2024-04-06T03:33:50.696382+0000","last_active":"2024-04-06T03:34:30.424107+0000","last_peered":"2024-04-06T03:34:30.424107+0000","last_clean":"2024-04-06T03:34:30.424107+0000","last_became_active":"2024-04-06T03:33:50.696055+0000","last_became_peered":"2024-04-06T03:33:50.696055+0000","last_unstale":"2024-04-06T03:34:30.424107+0000","last_undegraded":"2024-04-06T03:34:30.424107+0000","last_fullsized":"2024-04-06T03:34:30.424107+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:35:38.938672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"68'25","reported_seq":72,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.487913+0000","last_change":"2024-04-06T03:33:52.811464+0000","last_active":"2024-04-06T03:34:30.487913+0000","last_peered":"2024-04-06T03:34:30.487913+0000","last_clean":"2024-04-06T03:34:30.487913+0000","last_became_active":"2024-04-06T03:33:52.811031+0000","last_became_peered":"2024-04-06T03:33:52.811031+0000","last_unstale":"2024-04-06T03:34:30.487913+0000","last_undegraded":"2024-04-06T03:34:30.487913+0000","last_fullsized":"2024-04-06T03:34:30.487913+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:18:51.063191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.313722+0000","last_change":"2024-04-06T03:33:56.712241+0000","last_active":"2024-04-06T03:34:30.313722+0000","last_peered":"2024-04-06T03:34:30.313722+0000","last_clean":"2024-04-06T03:34:30.313722+0000","last_became_active":"2024-04-06T03:33:56.711867+0000","last_became_peered":"2024-04-06T03:33:56.711867+0000","last_unstale":"2024-04-06T03:34:30.313722+0000","last_undegraded":"2024-04-06T03:34:30.313722+0000","last_fullsized":"2024-04-06T03:34:30.313722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:48:13.419055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315161+0000","last_change":"2024-04-06T03:33:54.694866+0000","last_active":"2024-04-06T03:34:30.315161+0000","last_peered":"2024-04-06T03:34:30.315161+0000","last_clean":"2024-04-06T03:34:30.315161+0000","last_became_active":"2024-04-06T03:33:54.694210+0000","last_became_peered":"2024-04-06T03:33:54.694210+0000","last_unstale":"2024-04-06T03:34:30.315161+0000","last_undegraded":"2024-04-06T03:34:30.315161+0000","last_fullsized":"2024-04-06T03:34:30.315161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:10:46.977747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411444+0000","last_change":"2024-04-06T03:33:50.691582+0000","last_active":"2024-04-06T03:34:30.411444+0000","last_peered":"2024-04-06T03:34:30.411444+0000","last_clean":"2024-04-06T03:34:30.411444+0000","last_became_active":"2024-04-06T03:33:50.691301+0000","last_became_peered":"2024-04-06T03:33:50.691301+0000","last_unstale":"2024-04-06T03:34:30.411444+0000","last_undegraded":"2024-04-06T03:34:30.411444+0000","last_fullsized":"2024-04-06T03:34:30.411444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:17:55.999143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"68'15","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314448+0000","last_change":"2024-04-06T03:33:52.694355+0000","last_active":"2024-04-06T03:34:30.314448+0000","last_peered":"2024-04-06T03:34:30.314448+0000","last_clean":"2024-04-06T03:34:30.314448+0000","last_became_active":"2024-04-06T03:33:52.694016+0000","last_became_peered":"2024-04-06T03:33:52.694016+0000","last_unstale":"2024-04-06T03:34:30.314448+0000","last_undegraded":"2024-04-06T03:34:30.314448+0000","last_fullsized":"2024-04-06T03:34:30.314448+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:04:31.865115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489906+0000","last_change":"2024-04-06T03:33:56.718309+0000","last_active":"2024-04-06T03:34:30.489906+0000","last_peered":"2024-04-06T03:34:30.489906+0000","last_clean":"2024-04-06T03:34:30.489906+0000","last_became_active":"2024-04-06T03:33:56.717434+0000","last_became_peered":"2024-04-06T03:33:56.717434+0000","last_unstale":"2024-04-06T03:34:30.489906+0000","last_undegraded":"2024-04-06T03:34:30.489906+0000","last_fullsized":"2024-04-06T03:34:30.489906+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:22:00.724271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"64'2","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411159+0000","last_change":"2024-04-06T03:33:53.691919+0000","last_active":"2024-04-06T03:34:30.411159+0000","last_peered":"2024-04-06T03:34:30.411159+0000","last_clean":"2024-04-06T03:34:30.411159+0000","last_became_active":"2024-04-06T03:33:49.682558+0000","last_became_peered":"2024-04-06T03:33:49.682558+0000","last_unstale":"2024-04-06T03:34:30.411159+0000","last_undegraded":"2024-04-06T03:34:30.411159+0000","last_fullsized":"2024-04-06T03:34:30.411159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_clean_scrub_stamp":"2024-04-06T03:33:48.672121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:55:00.015548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001366772,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315774+0000","last_change":"2024-04-06T03:33:50.695703+0000","last_active":"2024-04-06T03:34:30.315774+0000","last_peered":"2024-04-06T03:34:30.315774+0000","last_clean":"2024-04-06T03:34:30.315774+0000","last_became_active":"2024-04-06T03:33:50.694609+0000","last_became_peered":"2024-04-06T03:33:50.694609+0000","last_unstale":"2024-04-06T03:34:30.315774+0000","last_undegraded":"2024-04-06T03:34:30.315774+0000","last_fullsized":"2024-04-06T03:34:30.315774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:39:52.025164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"68'34","reported_seq":105,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751543+0000","last_change":"2024-04-06T03:33:52.699375+0000","last_active":"2024-04-06T03:35:00.751543+0000","last_peered":"2024-04-06T03:35:00.751543+0000","last_clean":"2024-04-06T03:35:00.751543+0000","last_became_active":"2024-04-06T03:33:52.698855+0000","last_became_peered":"2024-04-06T03:33:52.698855+0000","last_unstale":"2024-04-06T03:35:00.751543+0000","last_undegraded":"2024-04-06T03:35:00.751543+0000","last_fullsized":"2024-04-06T03:35:00.751543+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:31:05.718311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314330+0000","last_change":"2024-04-06T03:33:54.707824+0000","last_active":"2024-04-06T03:34:30.314330+0000","last_peered":"2024-04-06T03:34:30.314330+0000","last_clean":"2024-04-06T03:34:30.314330+0000","last_became_active":"2024-04-06T03:33:54.707465+0000","last_became_peered":"2024-04-06T03:33:54.707465+0000","last_unstale":"2024-04-06T03:34:30.314330+0000","last_undegraded":"2024-04-06T03:34:30.314330+0000","last_fullsized":"2024-04-06T03:34:30.314330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:25:03.617988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424211+0000","last_change":"2024-04-06T03:33:56.832241+0000","last_active":"2024-04-06T03:34:30.424211+0000","last_peered":"2024-04-06T03:34:30.424211+0000","last_clean":"2024-04-06T03:34:30.424211+0000","last_became_active":"2024-04-06T03:33:56.831884+0000","last_became_peered":"2024-04-06T03:33:56.831884+0000","last_unstale":"2024-04-06T03:34:30.424211+0000","last_undegraded":"2024-04-06T03:34:30.424211+0000","last_fullsized":"2024-04-06T03:34:30.424211+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:40:59.850462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488396+0000","last_change":"2024-04-06T03:33:50.687836+0000","last_active":"2024-04-06T03:34:30.488396+0000","last_peered":"2024-04-06T03:34:30.488396+0000","last_clean":"2024-04-06T03:34:30.488396+0000","last_became_active":"2024-04-06T03:33:50.687262+0000","last_became_peered":"2024-04-06T03:33:50.687262+0000","last_unstale":"2024-04-06T03:34:30.488396+0000","last_undegraded":"2024-04-06T03:34:30.488396+0000","last_fullsized":"2024-04-06T03:34:30.488396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:07:54.284413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315415+0000","last_change":"2024-04-06T03:33:53.686742+0000","last_active":"2024-04-06T03:34:30.315415+0000","last_peered":"2024-04-06T03:34:30.315415+0000","last_clean":"2024-04-06T03:34:30.315415+0000","last_became_active":"2024-04-06T03:33:49.679169+0000","last_became_peered":"2024-04-06T03:33:49.679169+0000","last_unstale":"2024-04-06T03:34:30.315415+0000","last_undegraded":"2024-04-06T03:34:30.315415+0000","last_fullsized":"2024-04-06T03:34:30.315415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_clean_scrub_stamp":"2024-04-06T03:33:48.672121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:40:14.806699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073858699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"68'19","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490612+0000","last_change":"2024-04-06T03:33:52.696018+0000","last_active":"2024-04-06T03:34:30.490612+0000","last_peered":"2024-04-06T03:34:30.490612+0000","last_clean":"2024-04-06T03:34:30.490612+0000","last_became_active":"2024-04-06T03:33:52.695689+0000","last_became_peered":"2024-04-06T03:33:52.695689+0000","last_unstale":"2024-04-06T03:34:30.490612+0000","last_undegraded":"2024-04-06T03:34:30.490612+0000","last_fullsized":"2024-04-06T03:34:30.490612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:57:27.634733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315905+0000","last_change":"2024-04-06T03:33:54.704746+0000","last_active":"2024-04-06T03:34:30.315905+0000","last_peered":"2024-04-06T03:34:30.315905+0000","last_clean":"2024-04-06T03:34:30.315905+0000","last_became_active":"2024-04-06T03:33:54.703641+0000","last_became_peered":"2024-04-06T03:33:54.703641+0000","last_unstale":"2024-04-06T03:34:30.315905+0000","last_undegraded":"2024-04-06T03:34:30.315905+0000","last_fullsized":"2024-04-06T03:34:30.315905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:04:29.252860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411442+0000","last_change":"2024-04-06T03:33:56.716117+0000","last_active":"2024-04-06T03:34:30.411442+0000","last_peered":"2024-04-06T03:34:30.411442+0000","last_clean":"2024-04-06T03:34:30.411442+0000","last_became_active":"2024-04-06T03:33:56.715811+0000","last_became_peered":"2024-04-06T03:33:56.715811+0000","last_unstale":"2024-04-06T03:34:30.411442+0000","last_undegraded":"2024-04-06T03:34:30.411442+0000","last_fullsized":"2024-04-06T03:34:30.411442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:04:56.007232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":278,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:32.415686+0000","last_change":"2024-04-06T03:33:39.890844+0000","last_active":"2024-04-06T03:34:32.415686+0000","last_peered":"2024-04-06T03:34:32.415686+0000","last_clean":"2024-04-06T03:34:32.415686+0000","last_became_active":"2024-04-06T03:33:39.890456+0000","last_became_peered":"2024-04-06T03:33:39.890456+0000","last_unstale":"2024-04-06T03:34:32.415686+0000","last_undegraded":"2024-04-06T03:34:32.415686+0000","last_fullsized":"2024-04-06T03:34:32.415686+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:31:33.069833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:31:33.069833+0000","last_clean_scrub_stamp":"2024-04-06T03:31:33.069833+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T15:25:46.970624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488540+0000","last_change":"2024-04-06T03:33:50.692021+0000","last_active":"2024-04-06T03:34:30.488540+0000","last_peered":"2024-04-06T03:34:30.488540+0000","last_clean":"2024-04-06T03:34:30.488540+0000","last_became_active":"2024-04-06T03:33:50.691712+0000","last_became_peered":"2024-04-06T03:33:50.691712+0000","last_unstale":"2024-04-06T03:34:30.488540+0000","last_undegraded":"2024-04-06T03:34:30.488540+0000","last_fullsized":"2024-04-06T03:34:30.488540+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:59:00.563745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"68'16","reported_seq":67,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751896+0000","last_change":"2024-04-06T03:33:52.811939+0000","last_active":"2024-04-06T03:35:00.751896+0000","last_peered":"2024-04-06T03:35:00.751896+0000","last_clean":"2024-04-06T03:35:00.751896+0000","last_became_active":"2024-04-06T03:33:52.811577+0000","last_became_peered":"2024-04-06T03:33:52.811577+0000","last_unstale":"2024-04-06T03:35:00.751896+0000","last_undegraded":"2024-04-06T03:35:00.751896+0000","last_fullsized":"2024-04-06T03:35:00.751896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:25:41.951497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423910+0000","last_change":"2024-04-06T03:33:54.706742+0000","last_active":"2024-04-06T03:34:30.423910+0000","last_peered":"2024-04-06T03:34:30.423910+0000","last_clean":"2024-04-06T03:34:30.423910+0000","last_became_active":"2024-04-06T03:33:54.706429+0000","last_became_peered":"2024-04-06T03:33:54.706429+0000","last_unstale":"2024-04-06T03:34:30.423910+0000","last_undegraded":"2024-04-06T03:34:30.423910+0000","last_fullsized":"2024-04-06T03:34:30.423910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:43:15.370092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488733+0000","last_change":"2024-04-06T03:33:56.716573+0000","last_active":"2024-04-06T03:34:30.488733+0000","last_peered":"2024-04-06T03:34:30.488733+0000","last_clean":"2024-04-06T03:34:30.488733+0000","last_became_active":"2024-04-06T03:33:56.716217+0000","last_became_peered":"2024-04-06T03:33:56.716217+0000","last_unstale":"2024-04-06T03:34:30.488733+0000","last_undegraded":"2024-04-06T03:34:30.488733+0000","last_fullsized":"2024-04-06T03:34:30.488733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:19:14.461738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.313942+0000","last_change":"2024-04-06T03:33:50.688366+0000","last_active":"2024-04-06T03:34:30.313942+0000","last_peered":"2024-04-06T03:34:30.313942+0000","last_clean":"2024-04-06T03:34:30.313942+0000","last_became_active":"2024-04-06T03:33:50.687696+0000","last_became_peered":"2024-04-06T03:33:50.687696+0000","last_unstale":"2024-04-06T03:34:30.313942+0000","last_undegraded":"2024-04-06T03:34:30.313942+0000","last_fullsized":"2024-04-06T03:34:30.313942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:21:48.457739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"68'5","reported_seq":115,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:04.730466+0000","last_change":"2024-04-06T03:33:53.689427+0000","last_active":"2024-04-06T03:35:04.730466+0000","last_peered":"2024-04-06T03:35:04.730466+0000","last_clean":"2024-04-06T03:35:04.730466+0000","last_became_active":"2024-04-06T03:33:49.683439+0000","last_became_peered":"2024-04-06T03:33:49.683439+0000","last_unstale":"2024-04-06T03:35:04.730466+0000","last_undegraded":"2024-04-06T03:35:04.730466+0000","last_fullsized":"2024-04-06T03:35:04.730466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_clean_scrub_stamp":"2024-04-06T03:33:48.672121+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:16:51.231731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045094599999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"68'12","reported_seq":47,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314838+0000","last_change":"2024-04-06T03:33:52.698825+0000","last_active":"2024-04-06T03:34:30.314838+0000","last_peered":"2024-04-06T03:34:30.314838+0000","last_clean":"2024-04-06T03:34:30.314838+0000","last_became_active":"2024-04-06T03:33:52.698465+0000","last_became_peered":"2024-04-06T03:33:52.698465+0000","last_unstale":"2024-04-06T03:34:30.314838+0000","last_undegraded":"2024-04-06T03:34:30.314838+0000","last_fullsized":"2024-04-06T03:34:30.314838+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:23:32.568881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411748+0000","last_change":"2024-04-06T03:33:54.706224+0000","last_active":"2024-04-06T03:34:30.411748+0000","last_peered":"2024-04-06T03:34:30.411748+0000","last_clean":"2024-04-06T03:34:30.411748+0000","last_became_active":"2024-04-06T03:33:54.705922+0000","last_became_peered":"2024-04-06T03:33:54.705922+0000","last_unstale":"2024-04-06T03:34:30.411748+0000","last_undegraded":"2024-04-06T03:34:30.411748+0000","last_fullsized":"2024-04-06T03:34:30.411748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:32:09.363659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488975+0000","last_change":"2024-04-06T03:33:56.832627+0000","last_active":"2024-04-06T03:34:30.488975+0000","last_peered":"2024-04-06T03:34:30.488975+0000","last_clean":"2024-04-06T03:34:30.488975+0000","last_became_active":"2024-04-06T03:33:56.832102+0000","last_became_peered":"2024-04-06T03:33:56.832102+0000","last_unstale":"2024-04-06T03:34:30.488975+0000","last_undegraded":"2024-04-06T03:34:30.488975+0000","last_fullsized":"2024-04-06T03:34:30.488975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:37:07.699347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"61'1","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488970+0000","last_change":"2024-04-06T03:33:50.688624+0000","last_active":"2024-04-06T03:34:30.488970+0000","last_peered":"2024-04-06T03:34:30.488970+0000","last_clean":"2024-04-06T03:34:30.488970+0000","last_became_active":"2024-04-06T03:33:50.688301+0000","last_became_peered":"2024-04-06T03:33:50.688301+0000","last_unstale":"2024-04-06T03:34:30.488970+0000","last_undegraded":"2024-04-06T03:34:30.488970+0000","last_fullsized":"2024-04-06T03:34:30.488970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:00:00.636112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"68'25","reported_seq":77,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314582+0000","last_change":"2024-04-06T03:33:52.811114+0000","last_active":"2024-04-06T03:34:30.314582+0000","last_peered":"2024-04-06T03:34:30.314582+0000","last_clean":"2024-04-06T03:34:30.314582+0000","last_became_active":"2024-04-06T03:33:52.810693+0000","last_became_peered":"2024-04-06T03:33:52.810693+0000","last_unstale":"2024-04-06T03:34:30.314582+0000","last_undegraded":"2024-04-06T03:34:30.314582+0000","last_fullsized":"2024-04-06T03:34:30.314582+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:11:34.713463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.487917+0000","last_change":"2024-04-06T03:33:54.707813+0000","last_active":"2024-04-06T03:34:30.487917+0000","last_peered":"2024-04-06T03:34:30.487917+0000","last_clean":"2024-04-06T03:34:30.487917+0000","last_became_active":"2024-04-06T03:33:54.707438+0000","last_became_peered":"2024-04-06T03:33:54.707438+0000","last_unstale":"2024-04-06T03:34:30.487917+0000","last_undegraded":"2024-04-06T03:34:30.487917+0000","last_fullsized":"2024-04-06T03:34:30.487917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:45:51.701161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.313719+0000","last_change":"2024-04-06T03:33:56.716586+0000","last_active":"2024-04-06T03:34:30.313719+0000","last_peered":"2024-04-06T03:34:30.313719+0000","last_clean":"2024-04-06T03:34:30.313719+0000","last_became_active":"2024-04-06T03:33:56.716177+0000","last_became_peered":"2024-04-06T03:33:56.716177+0000","last_unstale":"2024-04-06T03:34:30.313719+0000","last_undegraded":"2024-04-06T03:34:30.313719+0000","last_fullsized":"2024-04-06T03:34:30.313719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:11:10.948829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411431+0000","last_change":"2024-04-06T03:33:50.686587+0000","last_active":"2024-04-06T03:34:30.411431+0000","last_peered":"2024-04-06T03:34:30.411431+0000","last_clean":"2024-04-06T03:34:30.411431+0000","last_became_active":"2024-04-06T03:33:50.686286+0000","last_became_peered":"2024-04-06T03:33:50.686286+0000","last_unstale":"2024-04-06T03:34:30.411431+0000","last_undegraded":"2024-04-06T03:34:30.411431+0000","last_fullsized":"2024-04-06T03:34:30.411431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:37:56.322075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"68'16","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488566+0000","last_change":"2024-04-06T03:33:52.696400+0000","last_active":"2024-04-06T03:34:30.488566+0000","last_peered":"2024-04-06T03:34:30.488566+0000","last_clean":"2024-04-06T03:34:30.488566+0000","last_became_active":"2024-04-06T03:33:52.695942+0000","last_became_peered":"2024-04-06T03:33:52.695942+0000","last_unstale":"2024-04-06T03:34:30.488566+0000","last_undegraded":"2024-04-06T03:34:30.488566+0000","last_fullsized":"2024-04-06T03:34:30.488566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:15:45.195123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751557+0000","last_change":"2024-04-06T03:33:54.705117+0000","last_active":"2024-04-06T03:35:00.751557+0000","last_peered":"2024-04-06T03:35:00.751557+0000","last_clean":"2024-04-06T03:35:00.751557+0000","last_became_active":"2024-04-06T03:33:54.704783+0000","last_became_peered":"2024-04-06T03:33:54.704783+0000","last_unstale":"2024-04-06T03:35:00.751557+0000","last_undegraded":"2024-04-06T03:35:00.751557+0000","last_fullsized":"2024-04-06T03:35:00.751557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:36:35.500692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423772+0000","last_change":"2024-04-06T03:33:56.833786+0000","last_active":"2024-04-06T03:34:30.423772+0000","last_peered":"2024-04-06T03:34:30.423772+0000","last_clean":"2024-04-06T03:34:30.423772+0000","last_became_active":"2024-04-06T03:33:56.833291+0000","last_became_peered":"2024-04-06T03:33:56.833291+0000","last_unstale":"2024-04-06T03:34:30.423772+0000","last_undegraded":"2024-04-06T03:34:30.423772+0000","last_fullsized":"2024-04-06T03:34:30.423772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:38:31.892116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"61'1","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314881+0000","last_change":"2024-04-06T03:33:50.691711+0000","last_active":"2024-04-06T03:34:30.314881+0000","last_peered":"2024-04-06T03:34:30.314881+0000","last_clean":"2024-04-06T03:34:30.314881+0000","last_became_active":"2024-04-06T03:33:50.691313+0000","last_became_peered":"2024-04-06T03:33:50.691313+0000","last_unstale":"2024-04-06T03:34:30.314881+0000","last_undegraded":"2024-04-06T03:34:30.314881+0000","last_fullsized":"2024-04-06T03:34:30.314881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:29:52.270917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'20","reported_seq":62,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315873+0000","last_change":"2024-04-06T03:33:52.695107+0000","last_active":"2024-04-06T03:34:30.315873+0000","last_peered":"2024-04-06T03:34:30.315873+0000","last_clean":"2024-04-06T03:34:30.315873+0000","last_became_active":"2024-04-06T03:33:52.694456+0000","last_became_peered":"2024-04-06T03:33:52.694456+0000","last_unstale":"2024-04-06T03:34:30.315873+0000","last_undegraded":"2024-04-06T03:34:30.315873+0000","last_fullsized":"2024-04-06T03:34:30.315873+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:23:31.809311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751573+0000","last_change":"2024-04-06T03:33:54.699673+0000","last_active":"2024-04-06T03:35:00.751573+0000","last_peered":"2024-04-06T03:35:00.751573+0000","last_clean":"2024-04-06T03:35:00.751573+0000","last_became_active":"2024-04-06T03:33:54.699358+0000","last_became_peered":"2024-04-06T03:33:54.699358+0000","last_unstale":"2024-04-06T03:35:00.751573+0000","last_undegraded":"2024-04-06T03:35:00.751573+0000","last_fullsized":"2024-04-06T03:35:00.751573+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:52:08.438183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315794+0000","last_change":"2024-04-06T03:33:56.714534+0000","last_active":"2024-04-06T03:34:30.315794+0000","last_peered":"2024-04-06T03:34:30.315794+0000","last_clean":"2024-04-06T03:34:30.315794+0000","last_became_active":"2024-04-06T03:33:56.713625+0000","last_became_peered":"2024-04-06T03:33:56.713625+0000","last_unstale":"2024-04-06T03:34:30.315794+0000","last_undegraded":"2024-04-06T03:34:30.315794+0000","last_fullsized":"2024-04-06T03:34:30.315794+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:08:24.529562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490421+0000","last_change":"2024-04-06T03:33:50.693168+0000","last_active":"2024-04-06T03:34:30.490421+0000","last_peered":"2024-04-06T03:34:30.490421+0000","last_clean":"2024-04-06T03:34:30.490421+0000","last_became_active":"2024-04-06T03:33:50.692859+0000","last_became_peered":"2024-04-06T03:33:50.692859+0000","last_unstale":"2024-04-06T03:34:30.490421+0000","last_undegraded":"2024-04-06T03:34:30.490421+0000","last_fullsized":"2024-04-06T03:34:30.490421+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:49:53.258475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"68'32","reported_seq":87,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488778+0000","last_change":"2024-04-06T03:33:52.812307+0000","last_active":"2024-04-06T03:34:30.488778+0000","last_peered":"2024-04-06T03:34:30.488778+0000","last_clean":"2024-04-06T03:34:30.488778+0000","last_became_active":"2024-04-06T03:33:52.811971+0000","last_became_peered":"2024-04-06T03:33:52.811971+0000","last_unstale":"2024-04-06T03:34:30.488778+0000","last_undegraded":"2024-04-06T03:34:30.488778+0000","last_fullsized":"2024-04-06T03:34:30.488778+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:24:58.168673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315591+0000","last_change":"2024-04-06T03:33:54.706043+0000","last_active":"2024-04-06T03:34:30.315591+0000","last_peered":"2024-04-06T03:34:30.315591+0000","last_clean":"2024-04-06T03:34:30.315591+0000","last_became_active":"2024-04-06T03:33:54.705623+0000","last_became_peered":"2024-04-06T03:33:54.705623+0000","last_unstale":"2024-04-06T03:34:30.315591+0000","last_undegraded":"2024-04-06T03:34:30.315591+0000","last_fullsized":"2024-04-06T03:34:30.315591+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T15:28:09.974776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411257+0000","last_change":"2024-04-06T03:33:56.712923+0000","last_active":"2024-04-06T03:34:30.411257+0000","last_peered":"2024-04-06T03:34:30.411257+0000","last_clean":"2024-04-06T03:34:30.411257+0000","last_became_active":"2024-04-06T03:33:56.712648+0000","last_became_peered":"2024-04-06T03:33:56.712648+0000","last_unstale":"2024-04-06T03:34:30.411257+0000","last_undegraded":"2024-04-06T03:34:30.411257+0000","last_fullsized":"2024-04-06T03:34:30.411257+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:48:18.985472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"68'8","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751784+0000","last_change":"2024-04-06T03:33:54.703407+0000","last_active":"2024-04-06T03:35:00.751784+0000","last_peered":"2024-04-06T03:35:00.751784+0000","last_clean":"2024-04-06T03:35:00.751784+0000","last_became_active":"2024-04-06T03:33:54.703111+0000","last_became_peered":"2024-04-06T03:33:54.703111+0000","last_unstale":"2024-04-06T03:35:00.751784+0000","last_undegraded":"2024-04-06T03:35:00.751784+0000","last_fullsized":"2024-04-06T03:35:00.751784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:50:04.515897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488713+0000","last_change":"2024-04-06T03:33:50.693186+0000","last_active":"2024-04-06T03:34:30.488713+0000","last_peered":"2024-04-06T03:34:30.488713+0000","last_clean":"2024-04-06T03:34:30.488713+0000","last_became_active":"2024-04-06T03:33:50.692840+0000","last_became_peered":"2024-04-06T03:33:50.692840+0000","last_unstale":"2024-04-06T03:34:30.488713+0000","last_undegraded":"2024-04-06T03:34:30.488713+0000","last_fullsized":"2024-04-06T03:34:30.488713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:58:33.366125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"68'15","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316077+0000","last_change":"2024-04-06T03:34:15.536448+0000","last_active":"2024-04-06T03:34:30.316077+0000","last_peered":"2024-04-06T03:34:30.316077+0000","last_clean":"2024-04-06T03:34:30.316077+0000","last_became_active":"2024-04-06T03:34:15.526759+0000","last_became_peered":"2024-04-06T03:34:15.526759+0000","last_unstale":"2024-04-06T03:34:30.316077+0000","last_undegraded":"2024-04-06T03:34:30.316077+0000","last_fullsized":"2024-04-06T03:34:30.316077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:09:29.449099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488783+0000","last_change":"2024-04-06T03:33:56.834232+0000","last_active":"2024-04-06T03:34:30.488783+0000","last_peered":"2024-04-06T03:34:30.488783+0000","last_clean":"2024-04-06T03:34:30.488783+0000","last_became_active":"2024-04-06T03:33:56.833864+0000","last_became_peered":"2024-04-06T03:33:56.833864+0000","last_unstale":"2024-04-06T03:34:30.488783+0000","last_undegraded":"2024-04-06T03:34:30.488783+0000","last_fullsized":"2024-04-06T03:34:30.488783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:25:38.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411743+0000","last_change":"2024-04-06T03:33:54.701555+0000","last_active":"2024-04-06T03:34:30.411743+0000","last_peered":"2024-04-06T03:34:30.411743+0000","last_clean":"2024-04-06T03:34:30.411743+0000","last_became_active":"2024-04-06T03:33:54.701263+0000","last_became_peered":"2024-04-06T03:33:54.701263+0000","last_unstale":"2024-04-06T03:34:30.411743+0000","last_undegraded":"2024-04-06T03:34:30.411743+0000","last_fullsized":"2024-04-06T03:34:30.411743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:51:33.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315631+0000","last_change":"2024-04-06T03:33:50.696209+0000","last_active":"2024-04-06T03:34:30.315631+0000","last_peered":"2024-04-06T03:34:30.315631+0000","last_clean":"2024-04-06T03:34:30.315631+0000","last_became_active":"2024-04-06T03:33:50.695856+0000","last_became_peered":"2024-04-06T03:33:50.695856+0000","last_unstale":"2024-04-06T03:34:30.315631+0000","last_undegraded":"2024-04-06T03:34:30.315631+0000","last_fullsized":"2024-04-06T03:34:30.315631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:04:29.191401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"68'17","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316638+0000","last_change":"2024-04-06T03:33:52.693928+0000","last_active":"2024-04-06T03:34:30.316638+0000","last_peered":"2024-04-06T03:34:30.316638+0000","last_clean":"2024-04-06T03:34:30.316638+0000","last_became_active":"2024-04-06T03:33:52.693570+0000","last_became_peered":"2024-04-06T03:33:52.693570+0000","last_unstale":"2024-04-06T03:34:30.316638+0000","last_undegraded":"2024-04-06T03:34:30.316638+0000","last_fullsized":"2024-04-06T03:34:30.316638+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:25:42.879230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316323+0000","last_change":"2024-04-06T03:33:56.716754+0000","last_active":"2024-04-06T03:34:30.316323+0000","last_peered":"2024-04-06T03:34:30.316323+0000","last_clean":"2024-04-06T03:34:30.316323+0000","last_became_active":"2024-04-06T03:33:56.715844+0000","last_became_peered":"2024-04-06T03:33:56.715844+0000","last_unstale":"2024-04-06T03:34:30.316323+0000","last_undegraded":"2024-04-06T03:34:30.316323+0000","last_fullsized":"2024-04-06T03:34:30.316323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:56:37.182490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489353+0000","last_change":"2024-04-06T03:33:54.703244+0000","last_active":"2024-04-06T03:34:30.489353+0000","last_peered":"2024-04-06T03:34:30.489353+0000","last_clean":"2024-04-06T03:34:30.489353+0000","last_became_active":"2024-04-06T03:33:54.703011+0000","last_became_peered":"2024-04-06T03:33:54.703011+0000","last_unstale":"2024-04-06T03:34:30.489353+0000","last_undegraded":"2024-04-06T03:34:30.489353+0000","last_fullsized":"2024-04-06T03:34:30.489353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:34:56.382731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488042+0000","last_change":"2024-04-06T03:33:50.691934+0000","last_active":"2024-04-06T03:34:30.488042+0000","last_peered":"2024-04-06T03:34:30.488042+0000","last_clean":"2024-04-06T03:34:30.488042+0000","last_became_active":"2024-04-06T03:33:50.691625+0000","last_became_peered":"2024-04-06T03:33:50.691625+0000","last_unstale":"2024-04-06T03:34:30.488042+0000","last_undegraded":"2024-04-06T03:34:30.488042+0000","last_fullsized":"2024-04-06T03:34:30.488042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:57:06.607885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"68'17","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316773+0000","last_change":"2024-04-06T03:33:52.688062+0000","last_active":"2024-04-06T03:34:30.316773+0000","last_peered":"2024-04-06T03:34:30.316773+0000","last_clean":"2024-04-06T03:34:30.316773+0000","last_became_active":"2024-04-06T03:33:52.687724+0000","last_became_peered":"2024-04-06T03:33:52.687724+0000","last_unstale":"2024-04-06T03:34:30.316773+0000","last_undegraded":"2024-04-06T03:34:30.316773+0000","last_fullsized":"2024-04-06T03:34:30.316773+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:29:47.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316591+0000","last_change":"2024-04-06T03:33:56.709390+0000","last_active":"2024-04-06T03:34:30.316591+0000","last_peered":"2024-04-06T03:34:30.316591+0000","last_clean":"2024-04-06T03:34:30.316591+0000","last_became_active":"2024-04-06T03:33:56.708876+0000","last_became_peered":"2024-04-06T03:33:56.708876+0000","last_unstale":"2024-04-06T03:34:30.316591+0000","last_undegraded":"2024-04-06T03:34:30.316591+0000","last_fullsized":"2024-04-06T03:34:30.316591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:28:28.005150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:00.751537+0000","last_change":"2024-04-06T03:33:54.707432+0000","last_active":"2024-04-06T03:35:00.751537+0000","last_peered":"2024-04-06T03:35:00.751537+0000","last_clean":"2024-04-06T03:35:00.751537+0000","last_became_active":"2024-04-06T03:33:54.707103+0000","last_became_peered":"2024-04-06T03:33:54.707103+0000","last_unstale":"2024-04-06T03:35:00.751537+0000","last_undegraded":"2024-04-06T03:35:00.751537+0000","last_fullsized":"2024-04-06T03:35:00.751537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:51:34.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489089+0000","last_change":"2024-04-06T03:33:50.691762+0000","last_active":"2024-04-06T03:34:30.489089+0000","last_peered":"2024-04-06T03:34:30.489089+0000","last_clean":"2024-04-06T03:34:30.489089+0000","last_became_active":"2024-04-06T03:33:50.691400+0000","last_became_peered":"2024-04-06T03:33:50.691400+0000","last_unstale":"2024-04-06T03:34:30.489089+0000","last_undegraded":"2024-04-06T03:34:30.489089+0000","last_fullsized":"2024-04-06T03:34:30.489089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:43:18.328699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315909+0000","last_change":"2024-04-06T03:33:52.698541+0000","last_active":"2024-04-06T03:34:30.315909+0000","last_peered":"2024-04-06T03:34:30.315909+0000","last_clean":"2024-04-06T03:34:30.315909+0000","last_became_active":"2024-04-06T03:33:52.698132+0000","last_became_peered":"2024-04-06T03:33:52.698132+0000","last_unstale":"2024-04-06T03:34:30.315909+0000","last_undegraded":"2024-04-06T03:34:30.315909+0000","last_fullsized":"2024-04-06T03:34:30.315909+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:02:25.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":383,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":986,"num_read_kb":711,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":589,"ondisk_log_size":589,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1457,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234004,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28304,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716848,"statfs":{"total":95995035648,"available":95966052352,"internally_reserved":0,"allocated":1318912,"data_stored":873231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495641,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28276,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716876,"statfs":{"total":95995035648,"available":95966081024,"internally_reserved":0,"allocated":1290240,"data_stored":871291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36084,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709068,"statfs":{"total":95995035648,"available":95958085632,"internally_reserved":0,"allocated":761856,"data_stored":282899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1323008,"data_stored":872973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411374,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713288,"statfs":{"total":95995035648,"available":95962406912,"internally_reserved":0,"allocated":700416,"data_stored":281546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182440,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717416,"statfs":{"total":95995035648,"available":95966633984,"internally_reserved":0,"allocated":733184,"data_stored":281814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018914,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713260,"statfs":{"total":95995035648,"available":95962378240,"internally_reserved":0,"allocated":729088,"data_stored":282403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757278,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713280,"statfs":{"total":95995035648,"available":95962398720,"internally_reserved":0,"allocated":708608,"data_stored":281757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-06T03:35:11.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-06T03:35:11.987 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:35:11 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:35:12.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:11 smithi047 ceph-mon[29365]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:12.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:11 smithi047 ceph-mon[37680]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:12.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:11 smithi102 ceph-mon[32821]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:13.213 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:12 smithi047 ceph-mon[37680]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:35:13.213 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:12 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:13.213 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:12 smithi047 ceph-mon[29365]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:35:13.213 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:12 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:13.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:12 smithi102 ceph-mon[32821]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:35:13.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:12 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:13.991 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:35:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:35:14.136 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:35:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:13 smithi047 ceph-mon[37680]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:13 smithi047 ceph-mon[29365]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:14.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:13 smithi102 ceph-mon[32821]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:15.994 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:15 smithi047 podman[72301]: 2024-04-06 03:35:15.970340024 +0000 UTC m=+0.451670173 container create 4b9662201f0a50bbf65c06e02126fe24a913aba2130c254590b6a9f7bd7b9e1e (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:16.291 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:15 smithi047 ceph-mon[29365]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:16.292 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:16.292 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:15 smithi047 ceph-mon[37680]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:16.292 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:16.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:15 smithi102 ceph-mon[32821]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:16.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:16.626 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 podman[72301]: 2024-04-06 03:35:16.2902321 +0000 UTC m=+0.771562258 container init 4b9662201f0a50bbf65c06e02126fe24a913aba2130c254590b6a9f7bd7b9e1e (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:16.626 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 podman[72301]: 2024-04-06 03:35:16.29338811 +0000 UTC m=+0.774718271 container start 4b9662201f0a50bbf65c06e02126fe24a913aba2130c254590b6a9f7bd7b9e1e (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:16.626 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:16.308Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-04-06T03:35:16.626 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:16.308Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-04-06T03:35:16.626 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:16.309Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.47 port=9094 2024-04-06T03:35:16.626 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:16.310Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-04-06T03:35:16.627 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:16.334Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-04-06T03:35:16.627 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:16.334Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-04-06T03:35:16.627 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:16.337Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-04-06T03:35:16.627 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:16.337Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-04-06T03:35:16.627 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 bash[72301]: 4b9662201f0a50bbf65c06e02126fe24a913aba2130c254590b6a9f7bd7b9e1e 2024-04-06T03:35:16.627 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:16 smithi047 systemd[1]: Started Ceph alertmanager.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:35:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 -- 172.21.15.47:0/2882624526 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ff806abd0 msgr2=0x7f3ff806afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 --2- 172.21.15.47:0/2882624526 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ff806abd0 0x7f3ff806afb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009920 tx=0x7f3fe8009c30 comp rx=0 tx=0).stop 2024-04-06T03:35:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 -- 172.21.15.47:0/2882624526 shutdown_connections 2024-04-06T03:35:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 --2- 172.21.15.47:0/2882624526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ff8107640 0x7f3ff810f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 --2- 172.21.15.47:0/2882624526 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ff806abd0 0x7f3ff806afb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 --2- 172.21.15.47:0/2882624526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff806b580 0x7f3ff8106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 -- 172.21.15.47:0/2882624526 >> 172.21.15.47:0/2882624526 conn(0x7f3ff8078140 msgr2=0x7f3ff8078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 -- 172.21.15.47:0/2882624526 shutdown_connections 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 -- 172.21.15.47:0/2882624526 wait complete. 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.638+0000 7f3ffde28700 1 Processor -- start 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ffde28700 1 -- start start 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ffde28700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff806abd0 0x7f3ff8101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ffde28700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ff806b580 0x7f3ff81017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ffde28700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ff8107640 0x7f3ff8101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ffde28700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff8111cb0 con 0x7f3ff806b580 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ffde28700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff8111b30 con 0x7f3ff806abd0 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ffde28700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff8111e30 con 0x7f3ff8107640 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3feffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ff806b580 0x7f3ff81017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3feffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ff806b580 0x7f3ff81017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60458/0 (socket says 172.21.15.47:60458) 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3feffff700 1 -- 172.21.15.47:0/1006566323 learned_addr learned my addr 172.21.15.47:0/1006566323 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ff7fff700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ff8107640 0x7f3ff8101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3ff77fe700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff806abd0 0x7f3ff8101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3feffff700 1 -- 172.21.15.47:0/1006566323 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ff8107640 msgr2=0x7f3ff8101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3feffff700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ff8107640 0x7f3ff8101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3feffff700 1 -- 172.21.15.47:0/1006566323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff806abd0 msgr2=0x7f3ff8101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3feffff700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff806abd0 0x7f3ff8101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.639+0000 7f3feffff700 1 -- 172.21.15.47:0/1006566323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff81a6780 con 0x7f3ff806b580 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.640+0000 7f3feffff700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ff806b580 0x7f3ff81017d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c970 tx=0x7f3fe000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.640+0000 7f3ff57fa700 1 -- 172.21.15.47:0/1006566323 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000ce60 con 0x7f3ff806b580 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.640+0000 7f3ff57fa700 1 -- 172.21.15.47:0/1006566323 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f3fe0004830 con 0x7f3ff806b580 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.640+0000 7f3ff57fa700 1 -- 172.21.15.47:0/1006566323 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00054c0 con 0x7f3ff806b580 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.640+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff81a6a70 con 0x7f3ff806b580 2024-04-06T03:35:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.640+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff81a6f60 con 0x7f3ff806b580 2024-04-06T03:35:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.641+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff81039f0 con 0x7f3ff806b580 2024-04-06T03:35:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.642+0000 7f3ff57fa700 1 -- 172.21.15.47:0/1006566323 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f3fe0007b00 con 0x7f3ff806b580 2024-04-06T03:35:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.642+0000 7f3ff57fa700 1 --2- 172.21.15.47:0/1006566323 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3fe406dc00 0x7f3fe40700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:16.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.642+0000 7f3ff77fe700 1 --2- 172.21.15.47:0/1006566323 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3fe406dc00 0x7f3fe40700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:16.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.642+0000 7f3ff57fa700 1 -- 172.21.15.47:0/1006566323 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f3fe008d650 con 0x7f3ff806b580 2024-04-06T03:35:16.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.643+0000 7f3ff77fe700 1 --2- 172.21.15.47:0/1006566323 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3fe406dc00 0x7f3fe40700c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009680 tx=0x7f3fe8019040 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:16.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.647+0000 7f3ff57fa700 1 -- 172.21.15.47:0/1006566323 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3fe0014030 con 0x7f3ff806b580 2024-04-06T03:35:16.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.858+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 --> v2:172.21.15.47:6800/3359778320 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ff80ff740 con 0x7f3fe406dc00 2024-04-06T03:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.869+0000 7f3ff57fa700 1 -- 172.21.15.47:0/1006566323 <== mgr.14568 v2:172.21.15.47:6800/3359778320 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346508 (secure 0 0 0) 0x7f3ff80ff740 con 0x7f3fe406dc00 2024-04-06T03:35:16.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:35:16.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3fe406dc00 msgr2=0x7f3fe40700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:16.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 --2- 172.21.15.47:0/1006566323 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3fe406dc00 0x7f3fe40700c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009680 tx=0x7f3fe8019040 comp rx=0 tx=0).stop 2024-04-06T03:35:16.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ff806b580 msgr2=0x7f3ff81017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:16.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ff806b580 0x7f3ff81017d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c970 tx=0x7f3fe000cc80 comp rx=0 tx=0).stop 2024-04-06T03:35:16.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 shutdown_connections 2024-04-06T03:35:16.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 --2- 172.21.15.47:0/1006566323 >> v2:172.21.15.47:6800/3359778320 conn(0x7f3fe406dc00 0x7f3fe40700c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ff8107640 0x7f3ff8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff806abd0 0x7f3ff8101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 --2- 172.21.15.47:0/1006566323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ff806b580 0x7f3ff81017d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:16.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 >> 172.21.15.47:0/1006566323 conn(0x7f3ff8078140 msgr2=0x7f3ff80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:16.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 shutdown_connections 2024-04-06T03:35:16.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:16.872+0000 7f3ffde28700 1 -- 172.21.15.47:0/1006566323 wait complete. 2024-04-06T03:35:16.878 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-06T03:35:16.890 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:16] ENGINE Bus STOPPING 2024-04-06T03:35:16.890 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:16] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-06T03:35:16.890 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:16] ENGINE Bus STOPPED 2024-04-06T03:35:16.891 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:16] ENGINE Bus STARTING 2024-04-06T03:35:16.891 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:16] ENGINE Serving on http://:::9283 2024-04-06T03:35:16.891 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:16 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:16] ENGINE Bus STARTED 2024-04-06T03:35:17.648 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:17.648 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.648 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.648 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.648 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.648 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: Regenerating cephadm self-signed grafana TLS certificates 2024-04-06T03:35:17.648 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: Deploying daemon grafana.a on smithi102 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[29365]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.649 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: Regenerating cephadm self-signed grafana TLS certificates 2024-04-06T03:35:17.650 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.650 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.650 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-06T03:35:17.650 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-06T03:35:17.650 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.650 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: Deploying daemon grafana.a on smithi102 2024-04-06T03:35:17.650 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:17 smithi047 ceph-mon[37680]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:35:17.674 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-06T03:35:16.334933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596318,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":1297,"num_read_kb":1111,"num_write":807,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1771324,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":796,"ondisk_log_size":796,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":244336,"kb_used_data":7388,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749716880,"statfs":{"total":767960285184,"available":767710085120,"internally_reserved":0,"allocated":7565312,"data_stored":4027914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003100"},"pg_stats":[{"pgid":"6.1a","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315649+0000","last_change":"2024-04-06T03:33:56.707043+0000","last_active":"2024-04-06T03:34:30.315649+0000","last_peered":"2024-04-06T03:34:30.315649+0000","last_clean":"2024-04-06T03:34:30.315649+0000","last_became_active":"2024-04-06T03:33:56.706723+0000","last_became_peered":"2024-04-06T03:33:56.706723+0000","last_unstale":"2024-04-06T03:34:30.315649+0000","last_undegraded":"2024-04-06T03:34:30.315649+0000","last_fullsized":"2024-04-06T03:34:30.315649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:46:19.819209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489111+0000","last_change":"2024-04-06T03:33:54.706783+0000","last_active":"2024-04-06T03:34:30.489111+0000","last_peered":"2024-04-06T03:34:30.489111+0000","last_clean":"2024-04-06T03:34:30.489111+0000","last_became_active":"2024-04-06T03:33:54.706469+0000","last_became_peered":"2024-04-06T03:33:54.706469+0000","last_unstale":"2024-04-06T03:34:30.489111+0000","last_undegraded":"2024-04-06T03:34:30.489111+0000","last_fullsized":"2024-04-06T03:34:30.489111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:41:27.809558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314553+0000","last_change":"2024-04-06T03:33:50.681808+0000","last_active":"2024-04-06T03:34:30.314553+0000","last_peered":"2024-04-06T03:34:30.314553+0000","last_clean":"2024-04-06T03:34:30.314553+0000","last_became_active":"2024-04-06T03:33:50.681425+0000","last_became_peered":"2024-04-06T03:33:50.681425+0000","last_unstale":"2024-04-06T03:34:30.314553+0000","last_undegraded":"2024-04-06T03:34:30.314553+0000","last_fullsized":"2024-04-06T03:34:30.314553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:20:29.105308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"68'15","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315567+0000","last_change":"2024-04-06T03:33:52.693575+0000","last_active":"2024-04-06T03:34:30.315567+0000","last_peered":"2024-04-06T03:34:30.315567+0000","last_clean":"2024-04-06T03:34:30.315567+0000","last_became_active":"2024-04-06T03:33:52.693271+0000","last_became_peered":"2024-04-06T03:33:52.693271+0000","last_unstale":"2024-04-06T03:34:30.315567+0000","last_undegraded":"2024-04-06T03:34:30.315567+0000","last_fullsized":"2024-04-06T03:34:30.315567+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:06:15.175922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488888+0000","last_change":"2024-04-06T03:33:56.834245+0000","last_active":"2024-04-06T03:34:30.488888+0000","last_peered":"2024-04-06T03:34:30.488888+0000","last_clean":"2024-04-06T03:34:30.488888+0000","last_became_active":"2024-04-06T03:33:56.833882+0000","last_became_peered":"2024-04-06T03:33:56.833882+0000","last_unstale":"2024-04-06T03:34:30.488888+0000","last_undegraded":"2024-04-06T03:34:30.488888+0000","last_fullsized":"2024-04-06T03:34:30.488888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:42:35.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315567+0000","last_change":"2024-04-06T03:33:54.704064+0000","last_active":"2024-04-06T03:34:30.315567+0000","last_peered":"2024-04-06T03:34:30.315567+0000","last_clean":"2024-04-06T03:34:30.315567+0000","last_became_active":"2024-04-06T03:33:54.703770+0000","last_became_peered":"2024-04-06T03:33:54.703770+0000","last_unstale":"2024-04-06T03:34:30.315567+0000","last_undegraded":"2024-04-06T03:34:30.315567+0000","last_fullsized":"2024-04-06T03:34:30.315567+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:23:05.128989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490191+0000","last_change":"2024-04-06T03:33:50.695432+0000","last_active":"2024-04-06T03:34:30.490191+0000","last_peered":"2024-04-06T03:34:30.490191+0000","last_clean":"2024-04-06T03:34:30.490191+0000","last_became_active":"2024-04-06T03:33:50.694807+0000","last_became_peered":"2024-04-06T03:33:50.694807+0000","last_unstale":"2024-04-06T03:34:30.490191+0000","last_undegraded":"2024-04-06T03:34:30.490191+0000","last_fullsized":"2024-04-06T03:34:30.490191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:15:55.693519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"68'39","reported_seq":102,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488543+0000","last_change":"2024-04-06T03:33:52.694298+0000","last_active":"2024-04-06T03:34:30.488543+0000","last_peered":"2024-04-06T03:34:30.488543+0000","last_clean":"2024-04-06T03:34:30.488543+0000","last_became_active":"2024-04-06T03:33:52.693950+0000","last_became_peered":"2024-04-06T03:33:52.693950+0000","last_unstale":"2024-04-06T03:34:30.488543+0000","last_undegraded":"2024-04-06T03:34:30.488543+0000","last_fullsized":"2024-04-06T03:34:30.488543+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:36:46.676045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"68'1","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314023+0000","last_change":"2024-04-06T03:33:56.717422+0000","last_active":"2024-04-06T03:34:30.314023+0000","last_peered":"2024-04-06T03:34:30.314023+0000","last_clean":"2024-04-06T03:34:30.314023+0000","last_became_active":"2024-04-06T03:33:56.717109+0000","last_became_peered":"2024-04-06T03:33:56.717109+0000","last_unstale":"2024-04-06T03:34:30.314023+0000","last_undegraded":"2024-04-06T03:34:30.314023+0000","last_fullsized":"2024-04-06T03:34:30.314023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:13:49.521131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411251+0000","last_change":"2024-04-06T03:33:54.707223+0000","last_active":"2024-04-06T03:34:30.411251+0000","last_peered":"2024-04-06T03:34:30.411251+0000","last_clean":"2024-04-06T03:34:30.411251+0000","last_became_active":"2024-04-06T03:33:54.706881+0000","last_became_peered":"2024-04-06T03:33:54.706881+0000","last_unstale":"2024-04-06T03:34:30.411251+0000","last_undegraded":"2024-04-06T03:34:30.411251+0000","last_fullsized":"2024-04-06T03:34:30.411251+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:19:18.573623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411261+0000","last_change":"2024-04-06T03:33:50.688804+0000","last_active":"2024-04-06T03:34:30.411261+0000","last_peered":"2024-04-06T03:34:30.411261+0000","last_clean":"2024-04-06T03:34:30.411261+0000","last_became_active":"2024-04-06T03:33:50.688461+0000","last_became_peered":"2024-04-06T03:33:50.688461+0000","last_unstale":"2024-04-06T03:34:30.411261+0000","last_undegraded":"2024-04-06T03:34:30.411261+0000","last_fullsized":"2024-04-06T03:34:30.411261+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:17:29.971286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"68'23","reported_seq":71,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316031+0000","last_change":"2024-04-06T03:33:52.695910+0000","last_active":"2024-04-06T03:34:30.316031+0000","last_peered":"2024-04-06T03:34:30.316031+0000","last_clean":"2024-04-06T03:34:30.316031+0000","last_became_active":"2024-04-06T03:33:52.694932+0000","last_became_peered":"2024-04-06T03:33:52.694932+0000","last_unstale":"2024-04-06T03:34:30.316031+0000","last_undegraded":"2024-04-06T03:34:30.316031+0000","last_fullsized":"2024-04-06T03:34:30.316031+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:12:01.140912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.410905+0000","last_change":"2024-04-06T03:33:56.710968+0000","last_active":"2024-04-06T03:34:30.410905+0000","last_peered":"2024-04-06T03:34:30.410905+0000","last_clean":"2024-04-06T03:34:30.410905+0000","last_became_active":"2024-04-06T03:33:56.710733+0000","last_became_peered":"2024-04-06T03:33:56.710733+0000","last_unstale":"2024-04-06T03:34:30.410905+0000","last_undegraded":"2024-04-06T03:34:30.410905+0000","last_fullsized":"2024-04-06T03:34:30.410905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:53:04.280768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423484+0000","last_change":"2024-04-06T03:33:54.702936+0000","last_active":"2024-04-06T03:34:30.423484+0000","last_peered":"2024-04-06T03:34:30.423484+0000","last_clean":"2024-04-06T03:34:30.423484+0000","last_became_active":"2024-04-06T03:33:54.702644+0000","last_became_peered":"2024-04-06T03:33:54.702644+0000","last_unstale":"2024-04-06T03:34:30.423484+0000","last_undegraded":"2024-04-06T03:34:30.423484+0000","last_fullsized":"2024-04-06T03:34:30.423484+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:22:24.120594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411318+0000","last_change":"2024-04-06T03:33:50.687481+0000","last_active":"2024-04-06T03:34:30.411318+0000","last_peered":"2024-04-06T03:34:30.411318+0000","last_clean":"2024-04-06T03:34:30.411318+0000","last_became_active":"2024-04-06T03:33:50.687193+0000","last_became_peered":"2024-04-06T03:33:50.687193+0000","last_unstale":"2024-04-06T03:34:30.411318+0000","last_undegraded":"2024-04-06T03:34:30.411318+0000","last_fullsized":"2024-04-06T03:34:30.411318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:52:27.455051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"68'11","reported_seq":51,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316132+0000","last_change":"2024-04-06T03:33:52.696056+0000","last_active":"2024-04-06T03:34:30.316132+0000","last_peered":"2024-04-06T03:34:30.316132+0000","last_clean":"2024-04-06T03:34:30.316132+0000","last_became_active":"2024-04-06T03:33:52.695466+0000","last_became_peered":"2024-04-06T03:33:52.695466+0000","last_unstale":"2024-04-06T03:34:30.316132+0000","last_undegraded":"2024-04-06T03:34:30.316132+0000","last_fullsized":"2024-04-06T03:34:30.316132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:06:39.372389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316367+0000","last_change":"2024-04-06T03:33:56.831915+0000","last_active":"2024-04-06T03:34:30.316367+0000","last_peered":"2024-04-06T03:34:30.316367+0000","last_clean":"2024-04-06T03:34:30.316367+0000","last_became_active":"2024-04-06T03:33:56.831584+0000","last_became_peered":"2024-04-06T03:33:56.831584+0000","last_unstale":"2024-04-06T03:34:30.316367+0000","last_undegraded":"2024-04-06T03:34:30.316367+0000","last_fullsized":"2024-04-06T03:34:30.316367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:49:23.395533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489718+0000","last_change":"2024-04-06T03:33:54.706408+0000","last_active":"2024-04-06T03:34:30.489718+0000","last_peered":"2024-04-06T03:34:30.489718+0000","last_clean":"2024-04-06T03:34:30.489718+0000","last_became_active":"2024-04-06T03:33:54.705825+0000","last_became_peered":"2024-04-06T03:33:54.705825+0000","last_unstale":"2024-04-06T03:34:30.489718+0000","last_undegraded":"2024-04-06T03:34:30.489718+0000","last_fullsized":"2024-04-06T03:34:30.489718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:27:25.796532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314545+0000","last_change":"2024-04-06T03:33:50.693783+0000","last_active":"2024-04-06T03:34:30.314545+0000","last_peered":"2024-04-06T03:34:30.314545+0000","last_clean":"2024-04-06T03:34:30.314545+0000","last_became_active":"2024-04-06T03:33:50.693467+0000","last_became_peered":"2024-04-06T03:33:50.693467+0000","last_unstale":"2024-04-06T03:34:30.314545+0000","last_undegraded":"2024-04-06T03:34:30.314545+0000","last_fullsized":"2024-04-06T03:34:30.314545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:35:51.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"68'15","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315612+0000","last_change":"2024-04-06T03:33:52.690316+0000","last_active":"2024-04-06T03:34:30.315612+0000","last_peered":"2024-04-06T03:34:30.315612+0000","last_clean":"2024-04-06T03:34:30.315612+0000","last_became_active":"2024-04-06T03:33:52.689856+0000","last_became_peered":"2024-04-06T03:33:52.689856+0000","last_unstale":"2024-04-06T03:34:30.315612+0000","last_undegraded":"2024-04-06T03:34:30.315612+0000","last_fullsized":"2024-04-06T03:34:30.315612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T15:10:58.467688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490287+0000","last_change":"2024-04-06T03:33:56.832179+0000","last_active":"2024-04-06T03:34:30.490287+0000","last_peered":"2024-04-06T03:34:30.490287+0000","last_clean":"2024-04-06T03:34:30.490287+0000","last_became_active":"2024-04-06T03:33:56.831783+0000","last_became_peered":"2024-04-06T03:33:56.831783+0000","last_unstale":"2024-04-06T03:34:30.490287+0000","last_undegraded":"2024-04-06T03:34:30.490287+0000","last_fullsized":"2024-04-06T03:34:30.490287+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:11:29.530162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315800+0000","last_change":"2024-04-06T03:33:54.696531+0000","last_active":"2024-04-06T03:34:30.315800+0000","last_peered":"2024-04-06T03:34:30.315800+0000","last_clean":"2024-04-06T03:34:30.315800+0000","last_became_active":"2024-04-06T03:33:54.696252+0000","last_became_peered":"2024-04-06T03:33:54.696252+0000","last_unstale":"2024-04-06T03:34:30.315800+0000","last_undegraded":"2024-04-06T03:34:30.315800+0000","last_fullsized":"2024-04-06T03:34:30.315800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:53:44.647013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316050+0000","last_change":"2024-04-06T03:33:50.687716+0000","last_active":"2024-04-06T03:34:30.316050+0000","last_peered":"2024-04-06T03:34:30.316050+0000","last_clean":"2024-04-06T03:34:30.316050+0000","last_became_active":"2024-04-06T03:33:50.687366+0000","last_became_peered":"2024-04-06T03:33:50.687366+0000","last_unstale":"2024-04-06T03:34:30.316050+0000","last_undegraded":"2024-04-06T03:34:30.316050+0000","last_fullsized":"2024-04-06T03:34:30.316050+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:32:12.686096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"68'18","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489587+0000","last_change":"2024-04-06T03:33:52.701908+0000","last_active":"2024-04-06T03:34:30.489587+0000","last_peered":"2024-04-06T03:34:30.489587+0000","last_clean":"2024-04-06T03:34:30.489587+0000","last_became_active":"2024-04-06T03:33:52.701572+0000","last_became_peered":"2024-04-06T03:33:52.701572+0000","last_unstale":"2024-04-06T03:34:30.489587+0000","last_undegraded":"2024-04-06T03:34:30.489587+0000","last_fullsized":"2024-04-06T03:34:30.489587+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:32:53.378962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"68'1","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423785+0000","last_change":"2024-04-06T03:33:56.712311+0000","last_active":"2024-04-06T03:34:30.423785+0000","last_peered":"2024-04-06T03:34:30.423785+0000","last_clean":"2024-04-06T03:34:30.423785+0000","last_became_active":"2024-04-06T03:33:56.712014+0000","last_became_peered":"2024-04-06T03:33:56.712014+0000","last_unstale":"2024-04-06T03:34:30.423785+0000","last_undegraded":"2024-04-06T03:34:30.423785+0000","last_fullsized":"2024-04-06T03:34:30.423785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:39:42.452288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"68'8","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:05.752727+0000","last_change":"2024-04-06T03:33:54.705290+0000","last_active":"2024-04-06T03:35:05.752727+0000","last_peered":"2024-04-06T03:35:05.752727+0000","last_clean":"2024-04-06T03:35:05.752727+0000","last_became_active":"2024-04-06T03:33:54.704980+0000","last_became_peered":"2024-04-06T03:33:54.704980+0000","last_unstale":"2024-04-06T03:35:05.752727+0000","last_undegraded":"2024-04-06T03:35:05.752727+0000","last_fullsized":"2024-04-06T03:35:05.752727+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:49:17.609957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"61'1","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489211+0000","last_change":"2024-04-06T03:33:50.690939+0000","last_active":"2024-04-06T03:34:30.489211+0000","last_peered":"2024-04-06T03:34:30.489211+0000","last_clean":"2024-04-06T03:34:30.489211+0000","last_became_active":"2024-04-06T03:33:50.690400+0000","last_became_peered":"2024-04-06T03:33:50.690400+0000","last_unstale":"2024-04-06T03:34:30.489211+0000","last_undegraded":"2024-04-06T03:34:30.489211+0000","last_fullsized":"2024-04-06T03:34:30.489211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:55:28.052869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"68'16","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314992+0000","last_change":"2024-04-06T03:33:52.812361+0000","last_active":"2024-04-06T03:34:30.314992+0000","last_peered":"2024-04-06T03:34:30.314992+0000","last_clean":"2024-04-06T03:34:30.314992+0000","last_became_active":"2024-04-06T03:33:52.811941+0000","last_became_peered":"2024-04-06T03:33:52.811941+0000","last_unstale":"2024-04-06T03:34:30.314992+0000","last_undegraded":"2024-04-06T03:34:30.314992+0000","last_fullsized":"2024-04-06T03:34:30.314992+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:04:47.698211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489861+0000","last_change":"2024-04-06T03:33:56.707166+0000","last_active":"2024-04-06T03:34:30.489861+0000","last_peered":"2024-04-06T03:34:30.489861+0000","last_clean":"2024-04-06T03:34:30.489861+0000","last_became_active":"2024-04-06T03:33:56.706547+0000","last_became_peered":"2024-04-06T03:33:56.706547+0000","last_unstale":"2024-04-06T03:34:30.489861+0000","last_undegraded":"2024-04-06T03:34:30.489861+0000","last_fullsized":"2024-04-06T03:34:30.489861+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:09:31.235568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315318+0000","last_change":"2024-04-06T03:33:54.707695+0000","last_active":"2024-04-06T03:34:30.315318+0000","last_peered":"2024-04-06T03:34:30.315318+0000","last_clean":"2024-04-06T03:34:30.315318+0000","last_became_active":"2024-04-06T03:33:54.706736+0000","last_became_peered":"2024-04-06T03:33:54.706736+0000","last_unstale":"2024-04-06T03:34:30.315318+0000","last_undegraded":"2024-04-06T03:34:30.315318+0000","last_fullsized":"2024-04-06T03:34:30.315318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:52:49.229068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488011+0000","last_change":"2024-04-06T03:33:50.690633+0000","last_active":"2024-04-06T03:34:30.488011+0000","last_peered":"2024-04-06T03:34:30.488011+0000","last_clean":"2024-04-06T03:34:30.488011+0000","last_became_active":"2024-04-06T03:33:50.690329+0000","last_became_peered":"2024-04-06T03:33:50.690329+0000","last_unstale":"2024-04-06T03:34:30.488011+0000","last_undegraded":"2024-04-06T03:34:30.488011+0000","last_fullsized":"2024-04-06T03:34:30.488011+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:35:36.798953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"68'17","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488161+0000","last_change":"2024-04-06T03:33:52.699151+0000","last_active":"2024-04-06T03:34:30.488161+0000","last_peered":"2024-04-06T03:34:30.488161+0000","last_clean":"2024-04-06T03:34:30.488161+0000","last_became_active":"2024-04-06T03:33:52.698798+0000","last_became_peered":"2024-04-06T03:33:52.698798+0000","last_unstale":"2024-04-06T03:34:30.488161+0000","last_undegraded":"2024-04-06T03:34:30.488161+0000","last_fullsized":"2024-04-06T03:34:30.488161+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:36:59.218824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423468+0000","last_change":"2024-04-06T03:33:56.709223+0000","last_active":"2024-04-06T03:34:30.423468+0000","last_peered":"2024-04-06T03:34:30.423468+0000","last_clean":"2024-04-06T03:34:30.423468+0000","last_became_active":"2024-04-06T03:33:56.708907+0000","last_became_peered":"2024-04-06T03:33:56.708907+0000","last_unstale":"2024-04-06T03:34:30.423468+0000","last_undegraded":"2024-04-06T03:34:30.423468+0000","last_fullsized":"2024-04-06T03:34:30.423468+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:35:59.220196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.487725+0000","last_change":"2024-04-06T03:33:54.703438+0000","last_active":"2024-04-06T03:34:30.487725+0000","last_peered":"2024-04-06T03:34:30.487725+0000","last_clean":"2024-04-06T03:34:30.487725+0000","last_became_active":"2024-04-06T03:33:54.703133+0000","last_became_peered":"2024-04-06T03:33:54.703133+0000","last_unstale":"2024-04-06T03:34:30.487725+0000","last_undegraded":"2024-04-06T03:34:30.487725+0000","last_fullsized":"2024-04-06T03:34:30.487725+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:38:50.812962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314642+0000","last_change":"2024-04-06T03:33:50.686802+0000","last_active":"2024-04-06T03:34:30.314642+0000","last_peered":"2024-04-06T03:34:30.314642+0000","last_clean":"2024-04-06T03:34:30.314642+0000","last_became_active":"2024-04-06T03:33:50.686491+0000","last_became_peered":"2024-04-06T03:33:50.686491+0000","last_unstale":"2024-04-06T03:34:30.314642+0000","last_undegraded":"2024-04-06T03:34:30.314642+0000","last_fullsized":"2024-04-06T03:34:30.314642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:07:17.087039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"68'4","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488108+0000","last_change":"2024-04-06T03:33:52.701012+0000","last_active":"2024-04-06T03:34:30.488108+0000","last_peered":"2024-04-06T03:34:30.488108+0000","last_clean":"2024-04-06T03:34:30.488108+0000","last_became_active":"2024-04-06T03:33:52.700641+0000","last_became_peered":"2024-04-06T03:33:52.700641+0000","last_unstale":"2024-04-06T03:34:30.488108+0000","last_undegraded":"2024-04-06T03:34:30.488108+0000","last_fullsized":"2024-04-06T03:34:30.488108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:38:47.810393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488296+0000","last_change":"2024-04-06T03:33:56.832979+0000","last_active":"2024-04-06T03:34:30.488296+0000","last_peered":"2024-04-06T03:34:30.488296+0000","last_clean":"2024-04-06T03:34:30.488296+0000","last_became_active":"2024-04-06T03:33:56.831811+0000","last_became_peered":"2024-04-06T03:33:56.831811+0000","last_unstale":"2024-04-06T03:34:30.488296+0000","last_undegraded":"2024-04-06T03:34:30.488296+0000","last_fullsized":"2024-04-06T03:34:30.488296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:08:12.652208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423868+0000","last_change":"2024-04-06T03:33:54.703553+0000","last_active":"2024-04-06T03:34:30.423868+0000","last_peered":"2024-04-06T03:34:30.423868+0000","last_clean":"2024-04-06T03:34:30.423868+0000","last_became_active":"2024-04-06T03:33:54.703280+0000","last_became_peered":"2024-04-06T03:33:54.703280+0000","last_unstale":"2024-04-06T03:34:30.423868+0000","last_undegraded":"2024-04-06T03:34:30.423868+0000","last_fullsized":"2024-04-06T03:34:30.423868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:24:11.100343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411405+0000","last_change":"2024-04-06T03:33:50.691267+0000","last_active":"2024-04-06T03:34:30.411405+0000","last_peered":"2024-04-06T03:34:30.411405+0000","last_clean":"2024-04-06T03:34:30.411405+0000","last_became_active":"2024-04-06T03:33:50.690933+0000","last_became_peered":"2024-04-06T03:33:50.690933+0000","last_unstale":"2024-04-06T03:34:30.411405+0000","last_undegraded":"2024-04-06T03:34:30.411405+0000","last_fullsized":"2024-04-06T03:34:30.411405+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:04:00.021914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"68'17","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488399+0000","last_change":"2024-04-06T03:33:52.811275+0000","last_active":"2024-04-06T03:34:30.488399+0000","last_peered":"2024-04-06T03:34:30.488399+0000","last_clean":"2024-04-06T03:34:30.488399+0000","last_became_active":"2024-04-06T03:33:52.810900+0000","last_became_peered":"2024-04-06T03:33:52.810900+0000","last_unstale":"2024-04-06T03:34:30.488399+0000","last_undegraded":"2024-04-06T03:34:30.488399+0000","last_fullsized":"2024-04-06T03:34:30.488399+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:41:48.352142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.313715+0000","last_change":"2024-04-06T03:33:56.719670+0000","last_active":"2024-04-06T03:34:30.313715+0000","last_peered":"2024-04-06T03:34:30.313715+0000","last_clean":"2024-04-06T03:34:30.313715+0000","last_became_active":"2024-04-06T03:33:56.719282+0000","last_became_peered":"2024-04-06T03:33:56.719282+0000","last_unstale":"2024-04-06T03:34:30.313715+0000","last_undegraded":"2024-04-06T03:34:30.313715+0000","last_fullsized":"2024-04-06T03:34:30.313715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:41:21.590574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488994+0000","last_change":"2024-04-06T03:33:54.702257+0000","last_active":"2024-04-06T03:34:30.488994+0000","last_peered":"2024-04-06T03:34:30.488994+0000","last_clean":"2024-04-06T03:34:30.488994+0000","last_became_active":"2024-04-06T03:33:54.701857+0000","last_became_peered":"2024-04-06T03:33:54.701857+0000","last_unstale":"2024-04-06T03:34:30.488994+0000","last_undegraded":"2024-04-06T03:34:30.488994+0000","last_fullsized":"2024-04-06T03:34:30.488994+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:16:05.548433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424009+0000","last_change":"2024-04-06T03:33:50.697840+0000","last_active":"2024-04-06T03:34:30.424009+0000","last_peered":"2024-04-06T03:34:30.424009+0000","last_clean":"2024-04-06T03:34:30.424009+0000","last_became_active":"2024-04-06T03:33:50.697552+0000","last_became_peered":"2024-04-06T03:33:50.697552+0000","last_unstale":"2024-04-06T03:34:30.424009+0000","last_undegraded":"2024-04-06T03:34:30.424009+0000","last_fullsized":"2024-04-06T03:34:30.424009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:54:19.540225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"68'9","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.410917+0000","last_change":"2024-04-06T03:34:15.538250+0000","last_active":"2024-04-06T03:34:30.410917+0000","last_peered":"2024-04-06T03:34:30.410917+0000","last_clean":"2024-04-06T03:34:30.410917+0000","last_became_active":"2024-04-06T03:34:15.527665+0000","last_became_peered":"2024-04-06T03:34:15.527665+0000","last_unstale":"2024-04-06T03:34:30.410917+0000","last_undegraded":"2024-04-06T03:34:30.410917+0000","last_fullsized":"2024-04-06T03:34:30.410917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:15:58.337684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488000+0000","last_change":"2024-04-06T03:33:56.716750+0000","last_active":"2024-04-06T03:34:30.488000+0000","last_peered":"2024-04-06T03:34:30.488000+0000","last_clean":"2024-04-06T03:34:30.488000+0000","last_became_active":"2024-04-06T03:33:56.716370+0000","last_became_peered":"2024-04-06T03:33:56.716370+0000","last_unstale":"2024-04-06T03:34:30.488000+0000","last_undegraded":"2024-04-06T03:34:30.488000+0000","last_fullsized":"2024-04-06T03:34:30.488000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:26:25.400348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488459+0000","last_change":"2024-04-06T03:33:54.706600+0000","last_active":"2024-04-06T03:34:30.488459+0000","last_peered":"2024-04-06T03:34:30.488459+0000","last_clean":"2024-04-06T03:34:30.488459+0000","last_became_active":"2024-04-06T03:33:54.706295+0000","last_became_peered":"2024-04-06T03:33:54.706295+0000","last_unstale":"2024-04-06T03:34:30.488459+0000","last_undegraded":"2024-04-06T03:34:30.488459+0000","last_fullsized":"2024-04-06T03:34:30.488459+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:28:02.387377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316086+0000","last_change":"2024-04-06T03:33:50.696057+0000","last_active":"2024-04-06T03:34:30.316086+0000","last_peered":"2024-04-06T03:34:30.316086+0000","last_clean":"2024-04-06T03:34:30.316086+0000","last_became_active":"2024-04-06T03:33:50.694571+0000","last_became_peered":"2024-04-06T03:33:50.694571+0000","last_unstale":"2024-04-06T03:34:30.316086+0000","last_undegraded":"2024-04-06T03:34:30.316086+0000","last_fullsized":"2024-04-06T03:34:30.316086+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:40:18.500106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315961+0000","last_change":"2024-04-06T03:33:52.694209+0000","last_active":"2024-04-06T03:34:30.315961+0000","last_peered":"2024-04-06T03:34:30.315961+0000","last_clean":"2024-04-06T03:34:30.315961+0000","last_became_active":"2024-04-06T03:33:52.693751+0000","last_became_peered":"2024-04-06T03:33:52.693751+0000","last_unstale":"2024-04-06T03:34:30.315961+0000","last_undegraded":"2024-04-06T03:34:30.315961+0000","last_fullsized":"2024-04-06T03:34:30.315961+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:10:24.228571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314737+0000","last_change":"2024-04-06T03:33:56.719009+0000","last_active":"2024-04-06T03:34:30.314737+0000","last_peered":"2024-04-06T03:34:30.314737+0000","last_clean":"2024-04-06T03:34:30.314737+0000","last_became_active":"2024-04-06T03:33:56.718656+0000","last_became_peered":"2024-04-06T03:33:56.718656+0000","last_unstale":"2024-04-06T03:34:30.314737+0000","last_undegraded":"2024-04-06T03:34:30.314737+0000","last_fullsized":"2024-04-06T03:34:30.314737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:29:20.374916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:05.752736+0000","last_change":"2024-04-06T03:33:54.707513+0000","last_active":"2024-04-06T03:35:05.752736+0000","last_peered":"2024-04-06T03:35:05.752736+0000","last_clean":"2024-04-06T03:35:05.752736+0000","last_became_active":"2024-04-06T03:33:54.707056+0000","last_became_peered":"2024-04-06T03:33:54.707056+0000","last_unstale":"2024-04-06T03:35:05.752736+0000","last_undegraded":"2024-04-06T03:35:05.752736+0000","last_fullsized":"2024-04-06T03:35:05.752736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:47:01.921014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423535+0000","last_change":"2024-04-06T03:33:50.697394+0000","last_active":"2024-04-06T03:34:30.423535+0000","last_peered":"2024-04-06T03:34:30.423535+0000","last_clean":"2024-04-06T03:34:30.423535+0000","last_became_active":"2024-04-06T03:33:50.695010+0000","last_became_peered":"2024-04-06T03:33:50.695010+0000","last_unstale":"2024-04-06T03:34:30.423535+0000","last_undegraded":"2024-04-06T03:34:30.423535+0000","last_fullsized":"2024-04-06T03:34:30.423535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:26:00.280020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"68'22","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489420+0000","last_change":"2024-04-06T03:33:52.813042+0000","last_active":"2024-04-06T03:34:30.489420+0000","last_peered":"2024-04-06T03:34:30.489420+0000","last_clean":"2024-04-06T03:34:30.489420+0000","last_became_active":"2024-04-06T03:33:52.812731+0000","last_became_peered":"2024-04-06T03:33:52.812731+0000","last_unstale":"2024-04-06T03:34:30.489420+0000","last_undegraded":"2024-04-06T03:34:30.489420+0000","last_fullsized":"2024-04-06T03:34:30.489420+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:19:19.379905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316424+0000","last_change":"2024-04-06T03:33:56.709408+0000","last_active":"2024-04-06T03:34:30.316424+0000","last_peered":"2024-04-06T03:34:30.316424+0000","last_clean":"2024-04-06T03:34:30.316424+0000","last_became_active":"2024-04-06T03:33:56.708897+0000","last_became_peered":"2024-04-06T03:33:56.708897+0000","last_unstale":"2024-04-06T03:34:30.316424+0000","last_undegraded":"2024-04-06T03:34:30.316424+0000","last_fullsized":"2024-04-06T03:34:30.316424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:53:42.330731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:05.752707+0000","last_change":"2024-04-06T03:33:54.699217+0000","last_active":"2024-04-06T03:35:05.752707+0000","last_peered":"2024-04-06T03:35:05.752707+0000","last_clean":"2024-04-06T03:35:05.752707+0000","last_became_active":"2024-04-06T03:33:54.698895+0000","last_became_peered":"2024-04-06T03:33:54.698895+0000","last_unstale":"2024-04-06T03:35:05.752707+0000","last_undegraded":"2024-04-06T03:35:05.752707+0000","last_fullsized":"2024-04-06T03:35:05.752707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:49:13.427082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314176+0000","last_change":"2024-04-06T03:33:50.686804+0000","last_active":"2024-04-06T03:34:30.314176+0000","last_peered":"2024-04-06T03:34:30.314176+0000","last_clean":"2024-04-06T03:34:30.314176+0000","last_became_active":"2024-04-06T03:33:50.686520+0000","last_became_peered":"2024-04-06T03:33:50.686520+0000","last_unstale":"2024-04-06T03:34:30.314176+0000","last_undegraded":"2024-04-06T03:34:30.314176+0000","last_fullsized":"2024-04-06T03:34:30.314176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:36:28.245700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"68'15","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411593+0000","last_change":"2024-04-06T03:33:52.813015+0000","last_active":"2024-04-06T03:34:30.411593+0000","last_peered":"2024-04-06T03:34:30.411593+0000","last_clean":"2024-04-06T03:34:30.411593+0000","last_became_active":"2024-04-06T03:33:52.812103+0000","last_became_peered":"2024-04-06T03:33:52.812103+0000","last_unstale":"2024-04-06T03:34:30.411593+0000","last_undegraded":"2024-04-06T03:34:30.411593+0000","last_fullsized":"2024-04-06T03:34:30.411593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:33:15.715979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315868+0000","last_change":"2024-04-06T03:33:56.709011+0000","last_active":"2024-04-06T03:34:30.315868+0000","last_peered":"2024-04-06T03:34:30.315868+0000","last_clean":"2024-04-06T03:34:30.315868+0000","last_became_active":"2024-04-06T03:33:56.708676+0000","last_became_peered":"2024-04-06T03:33:56.708676+0000","last_unstale":"2024-04-06T03:34:30.315868+0000","last_undegraded":"2024-04-06T03:34:30.315868+0000","last_fullsized":"2024-04-06T03:34:30.315868+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:45:25.810089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490604+0000","last_change":"2024-04-06T03:33:54.700486+0000","last_active":"2024-04-06T03:34:30.490604+0000","last_peered":"2024-04-06T03:34:30.490604+0000","last_clean":"2024-04-06T03:34:30.490604+0000","last_became_active":"2024-04-06T03:33:54.700152+0000","last_became_peered":"2024-04-06T03:33:54.700152+0000","last_unstale":"2024-04-06T03:34:30.490604+0000","last_undegraded":"2024-04-06T03:34:30.490604+0000","last_fullsized":"2024-04-06T03:34:30.490604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:46:15.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423669+0000","last_change":"2024-04-06T03:33:50.696815+0000","last_active":"2024-04-06T03:34:30.423669+0000","last_peered":"2024-04-06T03:34:30.423669+0000","last_clean":"2024-04-06T03:34:30.423669+0000","last_became_active":"2024-04-06T03:33:50.695674+0000","last_became_peered":"2024-04-06T03:33:50.695674+0000","last_unstale":"2024-04-06T03:34:30.423669+0000","last_undegraded":"2024-04-06T03:34:30.423669+0000","last_fullsized":"2024-04-06T03:34:30.423669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:19:37.186435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"68'21","reported_seq":69,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315126+0000","last_change":"2024-04-06T03:33:52.811341+0000","last_active":"2024-04-06T03:34:30.315126+0000","last_peered":"2024-04-06T03:34:30.315126+0000","last_clean":"2024-04-06T03:34:30.315126+0000","last_became_active":"2024-04-06T03:33:52.810669+0000","last_became_peered":"2024-04-06T03:33:52.810669+0000","last_unstale":"2024-04-06T03:34:30.315126+0000","last_undegraded":"2024-04-06T03:34:30.315126+0000","last_fullsized":"2024-04-06T03:34:30.315126+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:43:40.070911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423980+0000","last_change":"2024-04-06T03:33:56.834351+0000","last_active":"2024-04-06T03:34:30.423980+0000","last_peered":"2024-04-06T03:34:30.423980+0000","last_clean":"2024-04-06T03:34:30.423980+0000","last_became_active":"2024-04-06T03:33:56.834074+0000","last_became_peered":"2024-04-06T03:33:56.834074+0000","last_unstale":"2024-04-06T03:34:30.423980+0000","last_undegraded":"2024-04-06T03:34:30.423980+0000","last_fullsized":"2024-04-06T03:34:30.423980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:18:47.113001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411517+0000","last_change":"2024-04-06T03:33:54.701666+0000","last_active":"2024-04-06T03:34:30.411517+0000","last_peered":"2024-04-06T03:34:30.411517+0000","last_clean":"2024-04-06T03:34:30.411517+0000","last_became_active":"2024-04-06T03:33:54.701372+0000","last_became_peered":"2024-04-06T03:33:54.701372+0000","last_unstale":"2024-04-06T03:34:30.411517+0000","last_undegraded":"2024-04-06T03:34:30.411517+0000","last_fullsized":"2024-04-06T03:34:30.411517+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:34:04.753694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.487675+0000","last_change":"2024-04-06T03:33:50.687441+0000","last_active":"2024-04-06T03:34:30.487675+0000","last_peered":"2024-04-06T03:34:30.487675+0000","last_clean":"2024-04-06T03:34:30.487675+0000","last_became_active":"2024-04-06T03:33:50.687103+0000","last_became_peered":"2024-04-06T03:33:50.687103+0000","last_unstale":"2024-04-06T03:34:30.487675+0000","last_undegraded":"2024-04-06T03:34:30.487675+0000","last_fullsized":"2024-04-06T03:34:30.487675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:48:29.737672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"68'12","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490685+0000","last_change":"2024-04-06T03:34:15.533918+0000","last_active":"2024-04-06T03:34:30.490685+0000","last_peered":"2024-04-06T03:34:30.490685+0000","last_clean":"2024-04-06T03:34:30.490685+0000","last_became_active":"2024-04-06T03:34:15.527207+0000","last_became_peered":"2024-04-06T03:34:15.527207+0000","last_unstale":"2024-04-06T03:34:30.490685+0000","last_undegraded":"2024-04-06T03:34:30.490685+0000","last_fullsized":"2024-04-06T03:34:30.490685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:22:56.392590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411445+0000","last_change":"2024-04-06T03:33:56.834787+0000","last_active":"2024-04-06T03:34:30.411445+0000","last_peered":"2024-04-06T03:34:30.411445+0000","last_clean":"2024-04-06T03:34:30.411445+0000","last_became_active":"2024-04-06T03:33:56.833620+0000","last_became_peered":"2024-04-06T03:33:56.833620+0000","last_unstale":"2024-04-06T03:34:30.411445+0000","last_undegraded":"2024-04-06T03:34:30.411445+0000","last_fullsized":"2024-04-06T03:34:30.411445+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:45:21.868767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"61'3","reported_seq":51,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424269+0000","last_change":"2024-04-06T03:33:50.700751+0000","last_active":"2024-04-06T03:34:30.424269+0000","last_peered":"2024-04-06T03:34:30.424269+0000","last_clean":"2024-04-06T03:34:30.424269+0000","last_became_active":"2024-04-06T03:33:50.700284+0000","last_became_peered":"2024-04-06T03:33:50.700284+0000","last_unstale":"2024-04-06T03:34:30.424269+0000","last_undegraded":"2024-04-06T03:34:30.424269+0000","last_fullsized":"2024-04-06T03:34:30.424269+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:21:59.195138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"68'27","reported_seq":78,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.410981+0000","last_change":"2024-04-06T03:33:52.812506+0000","last_active":"2024-04-06T03:34:30.410981+0000","last_peered":"2024-04-06T03:34:30.410981+0000","last_clean":"2024-04-06T03:34:30.410981+0000","last_became_active":"2024-04-06T03:33:52.812142+0000","last_became_peered":"2024-04-06T03:33:52.812142+0000","last_unstale":"2024-04-06T03:34:30.410981+0000","last_undegraded":"2024-04-06T03:34:30.410981+0000","last_fullsized":"2024-04-06T03:34:30.410981+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:37:36.172427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:05.752704+0000","last_change":"2024-04-06T03:33:54.708321+0000","last_active":"2024-04-06T03:35:05.752704+0000","last_peered":"2024-04-06T03:35:05.752704+0000","last_clean":"2024-04-06T03:35:05.752704+0000","last_became_active":"2024-04-06T03:33:54.707596+0000","last_became_peered":"2024-04-06T03:33:54.707596+0000","last_unstale":"2024-04-06T03:35:05.752704+0000","last_undegraded":"2024-04-06T03:35:05.752704+0000","last_fullsized":"2024-04-06T03:35:05.752704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:25:31.957077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488776+0000","last_change":"2024-04-06T03:33:56.718541+0000","last_active":"2024-04-06T03:34:30.488776+0000","last_peered":"2024-04-06T03:34:30.488776+0000","last_clean":"2024-04-06T03:34:30.488776+0000","last_became_active":"2024-04-06T03:33:56.717781+0000","last_became_peered":"2024-04-06T03:33:56.717781+0000","last_unstale":"2024-04-06T03:34:30.488776+0000","last_undegraded":"2024-04-06T03:34:30.488776+0000","last_fullsized":"2024-04-06T03:34:30.488776+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:42:17.900976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424181+0000","last_change":"2024-04-06T03:33:50.700542+0000","last_active":"2024-04-06T03:34:30.424181+0000","last_peered":"2024-04-06T03:34:30.424181+0000","last_clean":"2024-04-06T03:34:30.424181+0000","last_became_active":"2024-04-06T03:33:50.700196+0000","last_became_peered":"2024-04-06T03:33:50.700196+0000","last_unstale":"2024-04-06T03:34:30.424181+0000","last_undegraded":"2024-04-06T03:34:30.424181+0000","last_fullsized":"2024-04-06T03:34:30.424181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:00:31.246266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"68'24","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316209+0000","last_change":"2024-04-06T03:33:52.693101+0000","last_active":"2024-04-06T03:34:30.316209+0000","last_peered":"2024-04-06T03:34:30.316209+0000","last_clean":"2024-04-06T03:34:30.316209+0000","last_became_active":"2024-04-06T03:33:52.692718+0000","last_became_peered":"2024-04-06T03:33:52.692718+0000","last_unstale":"2024-04-06T03:34:30.316209+0000","last_undegraded":"2024-04-06T03:34:30.316209+0000","last_fullsized":"2024-04-06T03:34:30.316209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:00:00.924683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315111+0000","last_change":"2024-04-06T03:33:54.703306+0000","last_active":"2024-04-06T03:34:30.315111+0000","last_peered":"2024-04-06T03:34:30.315111+0000","last_clean":"2024-04-06T03:34:30.315111+0000","last_became_active":"2024-04-06T03:33:54.702945+0000","last_became_peered":"2024-04-06T03:33:54.702945+0000","last_unstale":"2024-04-06T03:34:30.315111+0000","last_undegraded":"2024-04-06T03:34:30.315111+0000","last_fullsized":"2024-04-06T03:34:30.315111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:45:44.332223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423357+0000","last_change":"2024-04-06T03:33:56.714951+0000","last_active":"2024-04-06T03:34:30.423357+0000","last_peered":"2024-04-06T03:34:30.423357+0000","last_clean":"2024-04-06T03:34:30.423357+0000","last_became_active":"2024-04-06T03:33:56.714419+0000","last_became_peered":"2024-04-06T03:33:56.714419+0000","last_unstale":"2024-04-06T03:34:30.423357+0000","last_undegraded":"2024-04-06T03:34:30.423357+0000","last_fullsized":"2024-04-06T03:34:30.423357+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:24:56.597155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315451+0000","last_change":"2024-04-06T03:33:54.703884+0000","last_active":"2024-04-06T03:34:30.315451+0000","last_peered":"2024-04-06T03:34:30.315451+0000","last_clean":"2024-04-06T03:34:30.315451+0000","last_became_active":"2024-04-06T03:33:54.703556+0000","last_became_peered":"2024-04-06T03:33:54.703556+0000","last_unstale":"2024-04-06T03:34:30.315451+0000","last_undegraded":"2024-04-06T03:34:30.315451+0000","last_fullsized":"2024-04-06T03:34:30.315451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:12:07.984217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424107+0000","last_change":"2024-04-06T03:33:50.696382+0000","last_active":"2024-04-06T03:34:30.424107+0000","last_peered":"2024-04-06T03:34:30.424107+0000","last_clean":"2024-04-06T03:34:30.424107+0000","last_became_active":"2024-04-06T03:33:50.696055+0000","last_became_peered":"2024-04-06T03:33:50.696055+0000","last_unstale":"2024-04-06T03:34:30.424107+0000","last_undegraded":"2024-04-06T03:34:30.424107+0000","last_fullsized":"2024-04-06T03:34:30.424107+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:35:38.938672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"68'25","reported_seq":72,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.487913+0000","last_change":"2024-04-06T03:33:52.811464+0000","last_active":"2024-04-06T03:34:30.487913+0000","last_peered":"2024-04-06T03:34:30.487913+0000","last_clean":"2024-04-06T03:34:30.487913+0000","last_became_active":"2024-04-06T03:33:52.811031+0000","last_became_peered":"2024-04-06T03:33:52.811031+0000","last_unstale":"2024-04-06T03:34:30.487913+0000","last_undegraded":"2024-04-06T03:34:30.487913+0000","last_fullsized":"2024-04-06T03:34:30.487913+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:18:51.063191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.313722+0000","last_change":"2024-04-06T03:33:56.712241+0000","last_active":"2024-04-06T03:34:30.313722+0000","last_peered":"2024-04-06T03:34:30.313722+0000","last_clean":"2024-04-06T03:34:30.313722+0000","last_became_active":"2024-04-06T03:33:56.711867+0000","last_became_peered":"2024-04-06T03:33:56.711867+0000","last_unstale":"2024-04-06T03:34:30.313722+0000","last_undegraded":"2024-04-06T03:34:30.313722+0000","last_fullsized":"2024-04-06T03:34:30.313722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:48:13.419055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315161+0000","last_change":"2024-04-06T03:33:54.694866+0000","last_active":"2024-04-06T03:34:30.315161+0000","last_peered":"2024-04-06T03:34:30.315161+0000","last_clean":"2024-04-06T03:34:30.315161+0000","last_became_active":"2024-04-06T03:33:54.694210+0000","last_became_peered":"2024-04-06T03:33:54.694210+0000","last_unstale":"2024-04-06T03:34:30.315161+0000","last_undegraded":"2024-04-06T03:34:30.315161+0000","last_fullsized":"2024-04-06T03:34:30.315161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:10:46.977747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411444+0000","last_change":"2024-04-06T03:33:50.691582+0000","last_active":"2024-04-06T03:34:30.411444+0000","last_peered":"2024-04-06T03:34:30.411444+0000","last_clean":"2024-04-06T03:34:30.411444+0000","last_became_active":"2024-04-06T03:33:50.691301+0000","last_became_peered":"2024-04-06T03:33:50.691301+0000","last_unstale":"2024-04-06T03:34:30.411444+0000","last_undegraded":"2024-04-06T03:34:30.411444+0000","last_fullsized":"2024-04-06T03:34:30.411444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:17:55.999143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"68'15","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314448+0000","last_change":"2024-04-06T03:33:52.694355+0000","last_active":"2024-04-06T03:34:30.314448+0000","last_peered":"2024-04-06T03:34:30.314448+0000","last_clean":"2024-04-06T03:34:30.314448+0000","last_became_active":"2024-04-06T03:33:52.694016+0000","last_became_peered":"2024-04-06T03:33:52.694016+0000","last_unstale":"2024-04-06T03:34:30.314448+0000","last_undegraded":"2024-04-06T03:34:30.314448+0000","last_fullsized":"2024-04-06T03:34:30.314448+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:04:31.865115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489906+0000","last_change":"2024-04-06T03:33:56.718309+0000","last_active":"2024-04-06T03:34:30.489906+0000","last_peered":"2024-04-06T03:34:30.489906+0000","last_clean":"2024-04-06T03:34:30.489906+0000","last_became_active":"2024-04-06T03:33:56.717434+0000","last_became_peered":"2024-04-06T03:33:56.717434+0000","last_unstale":"2024-04-06T03:34:30.489906+0000","last_undegraded":"2024-04-06T03:34:30.489906+0000","last_fullsized":"2024-04-06T03:34:30.489906+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:22:00.724271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"64'2","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411159+0000","last_change":"2024-04-06T03:33:53.691919+0000","last_active":"2024-04-06T03:34:30.411159+0000","last_peered":"2024-04-06T03:34:30.411159+0000","last_clean":"2024-04-06T03:34:30.411159+0000","last_became_active":"2024-04-06T03:33:49.682558+0000","last_became_peered":"2024-04-06T03:33:49.682558+0000","last_unstale":"2024-04-06T03:34:30.411159+0000","last_undegraded":"2024-04-06T03:34:30.411159+0000","last_fullsized":"2024-04-06T03:34:30.411159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_clean_scrub_stamp":"2024-04-06T03:33:48.672121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:55:00.015548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001366772,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315774+0000","last_change":"2024-04-06T03:33:50.695703+0000","last_active":"2024-04-06T03:34:30.315774+0000","last_peered":"2024-04-06T03:34:30.315774+0000","last_clean":"2024-04-06T03:34:30.315774+0000","last_became_active":"2024-04-06T03:33:50.694609+0000","last_became_peered":"2024-04-06T03:33:50.694609+0000","last_unstale":"2024-04-06T03:34:30.315774+0000","last_undegraded":"2024-04-06T03:34:30.315774+0000","last_fullsized":"2024-04-06T03:34:30.315774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:39:52.025164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"68'34","reported_seq":106,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:05.752371+0000","last_change":"2024-04-06T03:33:52.699375+0000","last_active":"2024-04-06T03:35:05.752371+0000","last_peered":"2024-04-06T03:35:05.752371+0000","last_clean":"2024-04-06T03:35:05.752371+0000","last_became_active":"2024-04-06T03:33:52.698855+0000","last_became_peered":"2024-04-06T03:33:52.698855+0000","last_unstale":"2024-04-06T03:35:05.752371+0000","last_undegraded":"2024-04-06T03:35:05.752371+0000","last_fullsized":"2024-04-06T03:35:05.752371+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:31:05.718311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":57,"num_read_kb":41,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314330+0000","last_change":"2024-04-06T03:33:54.707824+0000","last_active":"2024-04-06T03:34:30.314330+0000","last_peered":"2024-04-06T03:34:30.314330+0000","last_clean":"2024-04-06T03:34:30.314330+0000","last_became_active":"2024-04-06T03:33:54.707465+0000","last_became_peered":"2024-04-06T03:33:54.707465+0000","last_unstale":"2024-04-06T03:34:30.314330+0000","last_undegraded":"2024-04-06T03:34:30.314330+0000","last_fullsized":"2024-04-06T03:34:30.314330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:25:03.617988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.424211+0000","last_change":"2024-04-06T03:33:56.832241+0000","last_active":"2024-04-06T03:34:30.424211+0000","last_peered":"2024-04-06T03:34:30.424211+0000","last_clean":"2024-04-06T03:34:30.424211+0000","last_became_active":"2024-04-06T03:33:56.831884+0000","last_became_peered":"2024-04-06T03:33:56.831884+0000","last_unstale":"2024-04-06T03:34:30.424211+0000","last_undegraded":"2024-04-06T03:34:30.424211+0000","last_fullsized":"2024-04-06T03:34:30.424211+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:40:59.850462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488396+0000","last_change":"2024-04-06T03:33:50.687836+0000","last_active":"2024-04-06T03:34:30.488396+0000","last_peered":"2024-04-06T03:34:30.488396+0000","last_clean":"2024-04-06T03:34:30.488396+0000","last_became_active":"2024-04-06T03:33:50.687262+0000","last_became_peered":"2024-04-06T03:33:50.687262+0000","last_unstale":"2024-04-06T03:34:30.488396+0000","last_undegraded":"2024-04-06T03:34:30.488396+0000","last_fullsized":"2024-04-06T03:34:30.488396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:07:54.284413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315415+0000","last_change":"2024-04-06T03:33:53.686742+0000","last_active":"2024-04-06T03:34:30.315415+0000","last_peered":"2024-04-06T03:34:30.315415+0000","last_clean":"2024-04-06T03:34:30.315415+0000","last_became_active":"2024-04-06T03:33:49.679169+0000","last_became_peered":"2024-04-06T03:33:49.679169+0000","last_unstale":"2024-04-06T03:34:30.315415+0000","last_undegraded":"2024-04-06T03:34:30.315415+0000","last_fullsized":"2024-04-06T03:34:30.315415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_clean_scrub_stamp":"2024-04-06T03:33:48.672121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:40:14.806699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073858699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"68'19","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490612+0000","last_change":"2024-04-06T03:33:52.696018+0000","last_active":"2024-04-06T03:34:30.490612+0000","last_peered":"2024-04-06T03:34:30.490612+0000","last_clean":"2024-04-06T03:34:30.490612+0000","last_became_active":"2024-04-06T03:33:52.695689+0000","last_became_peered":"2024-04-06T03:33:52.695689+0000","last_unstale":"2024-04-06T03:34:30.490612+0000","last_undegraded":"2024-04-06T03:34:30.490612+0000","last_fullsized":"2024-04-06T03:34:30.490612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:57:27.634733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315905+0000","last_change":"2024-04-06T03:33:54.704746+0000","last_active":"2024-04-06T03:34:30.315905+0000","last_peered":"2024-04-06T03:34:30.315905+0000","last_clean":"2024-04-06T03:34:30.315905+0000","last_became_active":"2024-04-06T03:33:54.703641+0000","last_became_peered":"2024-04-06T03:33:54.703641+0000","last_unstale":"2024-04-06T03:34:30.315905+0000","last_undegraded":"2024-04-06T03:34:30.315905+0000","last_fullsized":"2024-04-06T03:34:30.315905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:04:29.252860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411442+0000","last_change":"2024-04-06T03:33:56.716117+0000","last_active":"2024-04-06T03:34:30.411442+0000","last_peered":"2024-04-06T03:34:30.411442+0000","last_clean":"2024-04-06T03:34:30.411442+0000","last_became_active":"2024-04-06T03:33:56.715811+0000","last_became_peered":"2024-04-06T03:33:56.715811+0000","last_unstale":"2024-04-06T03:34:30.411442+0000","last_undegraded":"2024-04-06T03:34:30.411442+0000","last_fullsized":"2024-04-06T03:34:30.411442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:04:56.007232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":278,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:32.415686+0000","last_change":"2024-04-06T03:33:39.890844+0000","last_active":"2024-04-06T03:34:32.415686+0000","last_peered":"2024-04-06T03:34:32.415686+0000","last_clean":"2024-04-06T03:34:32.415686+0000","last_became_active":"2024-04-06T03:33:39.890456+0000","last_became_peered":"2024-04-06T03:33:39.890456+0000","last_unstale":"2024-04-06T03:34:32.415686+0000","last_undegraded":"2024-04-06T03:34:32.415686+0000","last_fullsized":"2024-04-06T03:34:32.415686+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:31:33.069833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:31:33.069833+0000","last_clean_scrub_stamp":"2024-04-06T03:31:33.069833+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T15:25:46.970624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488540+0000","last_change":"2024-04-06T03:33:50.692021+0000","last_active":"2024-04-06T03:34:30.488540+0000","last_peered":"2024-04-06T03:34:30.488540+0000","last_clean":"2024-04-06T03:34:30.488540+0000","last_became_active":"2024-04-06T03:33:50.691712+0000","last_became_peered":"2024-04-06T03:33:50.691712+0000","last_unstale":"2024-04-06T03:34:30.488540+0000","last_undegraded":"2024-04-06T03:34:30.488540+0000","last_fullsized":"2024-04-06T03:34:30.488540+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:59:00.563745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"68'16","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:05.752787+0000","last_change":"2024-04-06T03:33:52.811939+0000","last_active":"2024-04-06T03:35:05.752787+0000","last_peered":"2024-04-06T03:35:05.752787+0000","last_clean":"2024-04-06T03:35:05.752787+0000","last_became_active":"2024-04-06T03:33:52.811577+0000","last_became_peered":"2024-04-06T03:33:52.811577+0000","last_unstale":"2024-04-06T03:35:05.752787+0000","last_undegraded":"2024-04-06T03:35:05.752787+0000","last_fullsized":"2024-04-06T03:35:05.752787+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:25:41.951497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423910+0000","last_change":"2024-04-06T03:33:54.706742+0000","last_active":"2024-04-06T03:34:30.423910+0000","last_peered":"2024-04-06T03:34:30.423910+0000","last_clean":"2024-04-06T03:34:30.423910+0000","last_became_active":"2024-04-06T03:33:54.706429+0000","last_became_peered":"2024-04-06T03:33:54.706429+0000","last_unstale":"2024-04-06T03:34:30.423910+0000","last_undegraded":"2024-04-06T03:34:30.423910+0000","last_fullsized":"2024-04-06T03:34:30.423910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:43:15.370092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488733+0000","last_change":"2024-04-06T03:33:56.716573+0000","last_active":"2024-04-06T03:34:30.488733+0000","last_peered":"2024-04-06T03:34:30.488733+0000","last_clean":"2024-04-06T03:34:30.488733+0000","last_became_active":"2024-04-06T03:33:56.716217+0000","last_became_peered":"2024-04-06T03:33:56.716217+0000","last_unstale":"2024-04-06T03:34:30.488733+0000","last_undegraded":"2024-04-06T03:34:30.488733+0000","last_fullsized":"2024-04-06T03:34:30.488733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T04:19:14.461738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.313942+0000","last_change":"2024-04-06T03:33:50.688366+0000","last_active":"2024-04-06T03:34:30.313942+0000","last_peered":"2024-04-06T03:34:30.313942+0000","last_clean":"2024-04-06T03:34:30.313942+0000","last_became_active":"2024-04-06T03:33:50.687696+0000","last_became_peered":"2024-04-06T03:33:50.687696+0000","last_unstale":"2024-04-06T03:34:30.313942+0000","last_undegraded":"2024-04-06T03:34:30.313942+0000","last_fullsized":"2024-04-06T03:34:30.313942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:21:48.457739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"68'5","reported_seq":120,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:09.736696+0000","last_change":"2024-04-06T03:33:53.689427+0000","last_active":"2024-04-06T03:35:09.736696+0000","last_peered":"2024-04-06T03:35:09.736696+0000","last_clean":"2024-04-06T03:35:09.736696+0000","last_became_active":"2024-04-06T03:33:49.683439+0000","last_became_peered":"2024-04-06T03:33:49.683439+0000","last_unstale":"2024-04-06T03:35:09.736696+0000","last_undegraded":"2024-04-06T03:35:09.736696+0000","last_fullsized":"2024-04-06T03:35:09.736696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:48.672121+0000","last_clean_scrub_stamp":"2024-04-06T03:33:48.672121+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:16:51.231731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045094599999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"68'12","reported_seq":47,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314838+0000","last_change":"2024-04-06T03:33:52.698825+0000","last_active":"2024-04-06T03:34:30.314838+0000","last_peered":"2024-04-06T03:34:30.314838+0000","last_clean":"2024-04-06T03:34:30.314838+0000","last_became_active":"2024-04-06T03:33:52.698465+0000","last_became_peered":"2024-04-06T03:33:52.698465+0000","last_unstale":"2024-04-06T03:34:30.314838+0000","last_undegraded":"2024-04-06T03:34:30.314838+0000","last_fullsized":"2024-04-06T03:34:30.314838+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:23:32.568881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411748+0000","last_change":"2024-04-06T03:33:54.706224+0000","last_active":"2024-04-06T03:34:30.411748+0000","last_peered":"2024-04-06T03:34:30.411748+0000","last_clean":"2024-04-06T03:34:30.411748+0000","last_became_active":"2024-04-06T03:33:54.705922+0000","last_became_peered":"2024-04-06T03:33:54.705922+0000","last_unstale":"2024-04-06T03:34:30.411748+0000","last_undegraded":"2024-04-06T03:34:30.411748+0000","last_fullsized":"2024-04-06T03:34:30.411748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:32:09.363659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488975+0000","last_change":"2024-04-06T03:33:56.832627+0000","last_active":"2024-04-06T03:34:30.488975+0000","last_peered":"2024-04-06T03:34:30.488975+0000","last_clean":"2024-04-06T03:34:30.488975+0000","last_became_active":"2024-04-06T03:33:56.832102+0000","last_became_peered":"2024-04-06T03:33:56.832102+0000","last_unstale":"2024-04-06T03:34:30.488975+0000","last_undegraded":"2024-04-06T03:34:30.488975+0000","last_fullsized":"2024-04-06T03:34:30.488975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:37:07.699347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"61'1","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488970+0000","last_change":"2024-04-06T03:33:50.688624+0000","last_active":"2024-04-06T03:34:30.488970+0000","last_peered":"2024-04-06T03:34:30.488970+0000","last_clean":"2024-04-06T03:34:30.488970+0000","last_became_active":"2024-04-06T03:33:50.688301+0000","last_became_peered":"2024-04-06T03:33:50.688301+0000","last_unstale":"2024-04-06T03:34:30.488970+0000","last_undegraded":"2024-04-06T03:34:30.488970+0000","last_fullsized":"2024-04-06T03:34:30.488970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:00:00.636112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"68'25","reported_seq":77,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314582+0000","last_change":"2024-04-06T03:33:52.811114+0000","last_active":"2024-04-06T03:34:30.314582+0000","last_peered":"2024-04-06T03:34:30.314582+0000","last_clean":"2024-04-06T03:34:30.314582+0000","last_became_active":"2024-04-06T03:33:52.810693+0000","last_became_peered":"2024-04-06T03:33:52.810693+0000","last_unstale":"2024-04-06T03:34:30.314582+0000","last_undegraded":"2024-04-06T03:34:30.314582+0000","last_fullsized":"2024-04-06T03:34:30.314582+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:11:34.713463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.487917+0000","last_change":"2024-04-06T03:33:54.707813+0000","last_active":"2024-04-06T03:34:30.487917+0000","last_peered":"2024-04-06T03:34:30.487917+0000","last_clean":"2024-04-06T03:34:30.487917+0000","last_became_active":"2024-04-06T03:33:54.707438+0000","last_became_peered":"2024-04-06T03:33:54.707438+0000","last_unstale":"2024-04-06T03:34:30.487917+0000","last_undegraded":"2024-04-06T03:34:30.487917+0000","last_fullsized":"2024-04-06T03:34:30.487917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T05:45:51.701161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.313719+0000","last_change":"2024-04-06T03:33:56.716586+0000","last_active":"2024-04-06T03:34:30.313719+0000","last_peered":"2024-04-06T03:34:30.313719+0000","last_clean":"2024-04-06T03:34:30.313719+0000","last_became_active":"2024-04-06T03:33:56.716177+0000","last_became_peered":"2024-04-06T03:33:56.716177+0000","last_unstale":"2024-04-06T03:34:30.313719+0000","last_undegraded":"2024-04-06T03:34:30.313719+0000","last_fullsized":"2024-04-06T03:34:30.313719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:11:10.948829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411431+0000","last_change":"2024-04-06T03:33:50.686587+0000","last_active":"2024-04-06T03:34:30.411431+0000","last_peered":"2024-04-06T03:34:30.411431+0000","last_clean":"2024-04-06T03:34:30.411431+0000","last_became_active":"2024-04-06T03:33:50.686286+0000","last_became_peered":"2024-04-06T03:33:50.686286+0000","last_unstale":"2024-04-06T03:34:30.411431+0000","last_undegraded":"2024-04-06T03:34:30.411431+0000","last_fullsized":"2024-04-06T03:34:30.411431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:37:56.322075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"68'16","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488566+0000","last_change":"2024-04-06T03:33:52.696400+0000","last_active":"2024-04-06T03:34:30.488566+0000","last_peered":"2024-04-06T03:34:30.488566+0000","last_clean":"2024-04-06T03:34:30.488566+0000","last_became_active":"2024-04-06T03:33:52.695942+0000","last_became_peered":"2024-04-06T03:33:52.695942+0000","last_unstale":"2024-04-06T03:34:30.488566+0000","last_undegraded":"2024-04-06T03:34:30.488566+0000","last_fullsized":"2024-04-06T03:34:30.488566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:15:45.195123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"68'8","reported_seq":51,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:10.753573+0000","last_change":"2024-04-06T03:33:54.705117+0000","last_active":"2024-04-06T03:35:10.753573+0000","last_peered":"2024-04-06T03:35:10.753573+0000","last_clean":"2024-04-06T03:35:10.753573+0000","last_became_active":"2024-04-06T03:33:54.704783+0000","last_became_peered":"2024-04-06T03:33:54.704783+0000","last_unstale":"2024-04-06T03:35:10.753573+0000","last_undegraded":"2024-04-06T03:35:10.753573+0000","last_fullsized":"2024-04-06T03:35:10.753573+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:36:35.500692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.423772+0000","last_change":"2024-04-06T03:33:56.833786+0000","last_active":"2024-04-06T03:34:30.423772+0000","last_peered":"2024-04-06T03:34:30.423772+0000","last_clean":"2024-04-06T03:34:30.423772+0000","last_became_active":"2024-04-06T03:33:56.833291+0000","last_became_peered":"2024-04-06T03:33:56.833291+0000","last_unstale":"2024-04-06T03:34:30.423772+0000","last_undegraded":"2024-04-06T03:34:30.423772+0000","last_fullsized":"2024-04-06T03:34:30.423772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:38:31.892116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"61'1","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.314881+0000","last_change":"2024-04-06T03:33:50.691711+0000","last_active":"2024-04-06T03:34:30.314881+0000","last_peered":"2024-04-06T03:34:30.314881+0000","last_clean":"2024-04-06T03:34:30.314881+0000","last_became_active":"2024-04-06T03:33:50.691313+0000","last_became_peered":"2024-04-06T03:33:50.691313+0000","last_unstale":"2024-04-06T03:34:30.314881+0000","last_undegraded":"2024-04-06T03:34:30.314881+0000","last_fullsized":"2024-04-06T03:34:30.314881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:29:52.270917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'20","reported_seq":62,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315873+0000","last_change":"2024-04-06T03:33:52.695107+0000","last_active":"2024-04-06T03:34:30.315873+0000","last_peered":"2024-04-06T03:34:30.315873+0000","last_clean":"2024-04-06T03:34:30.315873+0000","last_became_active":"2024-04-06T03:33:52.694456+0000","last_became_peered":"2024-04-06T03:33:52.694456+0000","last_unstale":"2024-04-06T03:34:30.315873+0000","last_undegraded":"2024-04-06T03:34:30.315873+0000","last_fullsized":"2024-04-06T03:34:30.315873+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:23:31.809311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:05.752393+0000","last_change":"2024-04-06T03:33:54.699673+0000","last_active":"2024-04-06T03:35:05.752393+0000","last_peered":"2024-04-06T03:35:05.752393+0000","last_clean":"2024-04-06T03:35:05.752393+0000","last_became_active":"2024-04-06T03:33:54.699358+0000","last_became_peered":"2024-04-06T03:33:54.699358+0000","last_unstale":"2024-04-06T03:35:05.752393+0000","last_undegraded":"2024-04-06T03:35:05.752393+0000","last_fullsized":"2024-04-06T03:35:05.752393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:52:08.438183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315794+0000","last_change":"2024-04-06T03:33:56.714534+0000","last_active":"2024-04-06T03:34:30.315794+0000","last_peered":"2024-04-06T03:34:30.315794+0000","last_clean":"2024-04-06T03:34:30.315794+0000","last_became_active":"2024-04-06T03:33:56.713625+0000","last_became_peered":"2024-04-06T03:33:56.713625+0000","last_unstale":"2024-04-06T03:34:30.315794+0000","last_undegraded":"2024-04-06T03:34:30.315794+0000","last_fullsized":"2024-04-06T03:34:30.315794+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T12:08:24.529562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.490421+0000","last_change":"2024-04-06T03:33:50.693168+0000","last_active":"2024-04-06T03:34:30.490421+0000","last_peered":"2024-04-06T03:34:30.490421+0000","last_clean":"2024-04-06T03:34:30.490421+0000","last_became_active":"2024-04-06T03:33:50.692859+0000","last_became_peered":"2024-04-06T03:33:50.692859+0000","last_unstale":"2024-04-06T03:34:30.490421+0000","last_undegraded":"2024-04-06T03:34:30.490421+0000","last_fullsized":"2024-04-06T03:34:30.490421+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:49:53.258475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"68'32","reported_seq":87,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488778+0000","last_change":"2024-04-06T03:33:52.812307+0000","last_active":"2024-04-06T03:34:30.488778+0000","last_peered":"2024-04-06T03:34:30.488778+0000","last_clean":"2024-04-06T03:34:30.488778+0000","last_became_active":"2024-04-06T03:33:52.811971+0000","last_became_peered":"2024-04-06T03:33:52.811971+0000","last_unstale":"2024-04-06T03:34:30.488778+0000","last_undegraded":"2024-04-06T03:34:30.488778+0000","last_fullsized":"2024-04-06T03:34:30.488778+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:24:58.168673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315591+0000","last_change":"2024-04-06T03:33:54.706043+0000","last_active":"2024-04-06T03:34:30.315591+0000","last_peered":"2024-04-06T03:34:30.315591+0000","last_clean":"2024-04-06T03:34:30.315591+0000","last_became_active":"2024-04-06T03:33:54.705623+0000","last_became_peered":"2024-04-06T03:33:54.705623+0000","last_unstale":"2024-04-06T03:34:30.315591+0000","last_undegraded":"2024-04-06T03:34:30.315591+0000","last_fullsized":"2024-04-06T03:34:30.315591+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T15:28:09.974776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411257+0000","last_change":"2024-04-06T03:33:56.712923+0000","last_active":"2024-04-06T03:34:30.411257+0000","last_peered":"2024-04-06T03:34:30.411257+0000","last_clean":"2024-04-06T03:34:30.411257+0000","last_became_active":"2024-04-06T03:33:56.712648+0000","last_became_peered":"2024-04-06T03:33:56.712648+0000","last_unstale":"2024-04-06T03:34:30.411257+0000","last_undegraded":"2024-04-06T03:34:30.411257+0000","last_fullsized":"2024-04-06T03:34:30.411257+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T14:48:18.985472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"68'8","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:05.752720+0000","last_change":"2024-04-06T03:33:54.703407+0000","last_active":"2024-04-06T03:35:05.752720+0000","last_peered":"2024-04-06T03:35:05.752720+0000","last_clean":"2024-04-06T03:35:05.752720+0000","last_became_active":"2024-04-06T03:33:54.703111+0000","last_became_peered":"2024-04-06T03:33:54.703111+0000","last_unstale":"2024-04-06T03:35:05.752720+0000","last_undegraded":"2024-04-06T03:35:05.752720+0000","last_fullsized":"2024-04-06T03:35:05.752720+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:50:04.515897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488713+0000","last_change":"2024-04-06T03:33:50.693186+0000","last_active":"2024-04-06T03:34:30.488713+0000","last_peered":"2024-04-06T03:34:30.488713+0000","last_clean":"2024-04-06T03:34:30.488713+0000","last_became_active":"2024-04-06T03:33:50.692840+0000","last_became_peered":"2024-04-06T03:33:50.692840+0000","last_unstale":"2024-04-06T03:34:30.488713+0000","last_undegraded":"2024-04-06T03:34:30.488713+0000","last_fullsized":"2024-04-06T03:34:30.488713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T09:58:33.366125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"68'15","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316077+0000","last_change":"2024-04-06T03:34:15.536448+0000","last_active":"2024-04-06T03:34:30.316077+0000","last_peered":"2024-04-06T03:34:30.316077+0000","last_clean":"2024-04-06T03:34:30.316077+0000","last_became_active":"2024-04-06T03:34:15.526759+0000","last_became_peered":"2024-04-06T03:34:15.526759+0000","last_unstale":"2024-04-06T03:34:30.316077+0000","last_undegraded":"2024-04-06T03:34:30.316077+0000","last_fullsized":"2024-04-06T03:34:30.316077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T10:09:29.449099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488783+0000","last_change":"2024-04-06T03:33:56.834232+0000","last_active":"2024-04-06T03:34:30.488783+0000","last_peered":"2024-04-06T03:34:30.488783+0000","last_clean":"2024-04-06T03:34:30.488783+0000","last_became_active":"2024-04-06T03:33:56.833864+0000","last_became_peered":"2024-04-06T03:33:56.833864+0000","last_unstale":"2024-04-06T03:34:30.488783+0000","last_undegraded":"2024-04-06T03:34:30.488783+0000","last_fullsized":"2024-04-06T03:34:30.488783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:25:38.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.411743+0000","last_change":"2024-04-06T03:33:54.701555+0000","last_active":"2024-04-06T03:34:30.411743+0000","last_peered":"2024-04-06T03:34:30.411743+0000","last_clean":"2024-04-06T03:34:30.411743+0000","last_became_active":"2024-04-06T03:33:54.701263+0000","last_became_peered":"2024-04-06T03:33:54.701263+0000","last_unstale":"2024-04-06T03:34:30.411743+0000","last_undegraded":"2024-04-06T03:34:30.411743+0000","last_fullsized":"2024-04-06T03:34:30.411743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:51:33.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315631+0000","last_change":"2024-04-06T03:33:50.696209+0000","last_active":"2024-04-06T03:34:30.315631+0000","last_peered":"2024-04-06T03:34:30.315631+0000","last_clean":"2024-04-06T03:34:30.315631+0000","last_became_active":"2024-04-06T03:33:50.695856+0000","last_became_peered":"2024-04-06T03:33:50.695856+0000","last_unstale":"2024-04-06T03:34:30.315631+0000","last_undegraded":"2024-04-06T03:34:30.315631+0000","last_fullsized":"2024-04-06T03:34:30.315631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:04:29.191401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"68'17","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316638+0000","last_change":"2024-04-06T03:33:52.693928+0000","last_active":"2024-04-06T03:34:30.316638+0000","last_peered":"2024-04-06T03:34:30.316638+0000","last_clean":"2024-04-06T03:34:30.316638+0000","last_became_active":"2024-04-06T03:33:52.693570+0000","last_became_peered":"2024-04-06T03:33:52.693570+0000","last_unstale":"2024-04-06T03:34:30.316638+0000","last_undegraded":"2024-04-06T03:34:30.316638+0000","last_fullsized":"2024-04-06T03:34:30.316638+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T13:25:42.879230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316323+0000","last_change":"2024-04-06T03:33:56.716754+0000","last_active":"2024-04-06T03:34:30.316323+0000","last_peered":"2024-04-06T03:34:30.316323+0000","last_clean":"2024-04-06T03:34:30.316323+0000","last_became_active":"2024-04-06T03:33:56.715844+0000","last_became_peered":"2024-04-06T03:33:56.715844+0000","last_unstale":"2024-04-06T03:34:30.316323+0000","last_undegraded":"2024-04-06T03:34:30.316323+0000","last_fullsized":"2024-04-06T03:34:30.316323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:56:37.182490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489353+0000","last_change":"2024-04-06T03:33:54.703244+0000","last_active":"2024-04-06T03:34:30.489353+0000","last_peered":"2024-04-06T03:34:30.489353+0000","last_clean":"2024-04-06T03:34:30.489353+0000","last_became_active":"2024-04-06T03:33:54.703011+0000","last_became_peered":"2024-04-06T03:33:54.703011+0000","last_unstale":"2024-04-06T03:34:30.489353+0000","last_undegraded":"2024-04-06T03:34:30.489353+0000","last_fullsized":"2024-04-06T03:34:30.489353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:34:56.382731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.488042+0000","last_change":"2024-04-06T03:33:50.691934+0000","last_active":"2024-04-06T03:34:30.488042+0000","last_peered":"2024-04-06T03:34:30.488042+0000","last_clean":"2024-04-06T03:34:30.488042+0000","last_became_active":"2024-04-06T03:33:50.691625+0000","last_became_peered":"2024-04-06T03:33:50.691625+0000","last_unstale":"2024-04-06T03:34:30.488042+0000","last_undegraded":"2024-04-06T03:34:30.488042+0000","last_fullsized":"2024-04-06T03:34:30.488042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T03:57:06.607885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"68'17","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316773+0000","last_change":"2024-04-06T03:33:52.688062+0000","last_active":"2024-04-06T03:34:30.316773+0000","last_peered":"2024-04-06T03:34:30.316773+0000","last_clean":"2024-04-06T03:34:30.316773+0000","last_became_active":"2024-04-06T03:33:52.687724+0000","last_became_peered":"2024-04-06T03:33:52.687724+0000","last_unstale":"2024-04-06T03:34:30.316773+0000","last_undegraded":"2024-04-06T03:34:30.316773+0000","last_fullsized":"2024-04-06T03:34:30.316773+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:29:47.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.316591+0000","last_change":"2024-04-06T03:33:56.709390+0000","last_active":"2024-04-06T03:34:30.316591+0000","last_peered":"2024-04-06T03:34:30.316591+0000","last_clean":"2024-04-06T03:34:30.316591+0000","last_became_active":"2024-04-06T03:33:56.708876+0000","last_became_peered":"2024-04-06T03:33:56.708876+0000","last_unstale":"2024-04-06T03:34:30.316591+0000","last_undegraded":"2024-04-06T03:34:30.316591+0000","last_fullsized":"2024-04-06T03:34:30.316591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:55.687769+0000","last_clean_scrub_stamp":"2024-04-06T03:33:55.687769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T07:28:28.005150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"68'8","reported_seq":51,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:35:10.753598+0000","last_change":"2024-04-06T03:33:54.707432+0000","last_active":"2024-04-06T03:35:10.753598+0000","last_peered":"2024-04-06T03:35:10.753598+0000","last_clean":"2024-04-06T03:35:10.753598+0000","last_became_active":"2024-04-06T03:33:54.707103+0000","last_became_peered":"2024-04-06T03:33:54.707103+0000","last_unstale":"2024-04-06T03:35:10.753598+0000","last_undegraded":"2024-04-06T03:35:10.753598+0000","last_fullsized":"2024-04-06T03:35:10.753598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:53.680194+0000","last_clean_scrub_stamp":"2024-04-06T03:33:53.680194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T08:51:34.700996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.489089+0000","last_change":"2024-04-06T03:33:50.691762+0000","last_active":"2024-04-06T03:34:30.489089+0000","last_peered":"2024-04-06T03:34:30.489089+0000","last_clean":"2024-04-06T03:34:30.489089+0000","last_became_active":"2024-04-06T03:33:50.691400+0000","last_became_peered":"2024-04-06T03:33:50.691400+0000","last_unstale":"2024-04-06T03:34:30.489089+0000","last_undegraded":"2024-04-06T03:34:30.489089+0000","last_fullsized":"2024-04-06T03:34:30.489089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:49.673378+0000","last_clean_scrub_stamp":"2024-04-06T03:33:49.673378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T11:43:18.328699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-06T03:34:30.315909+0000","last_change":"2024-04-06T03:33:52.698541+0000","last_active":"2024-04-06T03:34:30.315909+0000","last_peered":"2024-04-06T03:34:30.315909+0000","last_clean":"2024-04-06T03:34:30.315909+0000","last_became_active":"2024-04-06T03:33:52.698132+0000","last_became_peered":"2024-04-06T03:33:52.698132+0000","last_unstale":"2024-04-06T03:34:30.315909+0000","last_undegraded":"2024-04-06T03:34:30.315909+0000","last_fullsized":"2024-04-06T03:34:30.315909+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T03:33:51.677038+0000","last_clean_scrub_stamp":"2024-04-06T03:33:51.677038+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-07T06:02:25.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":383,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":986,"num_read_kb":711,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":589,"ondisk_log_size":589,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1457,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234005,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28304,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716848,"statfs":{"total":95995035648,"available":95966052352,"internally_reserved":0,"allocated":1318912,"data_stored":873231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495642,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28276,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716876,"statfs":{"total":95995035648,"available":95966081024,"internally_reserved":0,"allocated":1290240,"data_stored":871291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36084,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709068,"statfs":{"total":95995035648,"available":95958085632,"internally_reserved":0,"allocated":761856,"data_stored":282899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1323008,"data_stored":872973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713288,"statfs":{"total":95995035648,"available":95962406912,"internally_reserved":0,"allocated":700416,"data_stored":281546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182441,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717416,"statfs":{"total":95995035648,"available":95966633984,"internally_reserved":0,"allocated":733184,"data_stored":281814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018915,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713260,"statfs":{"total":95995035648,"available":95962378240,"internally_reserved":0,"allocated":729088,"data_stored":282403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757279,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713280,"statfs":{"total":95995035648,"available":95962398720,"internally_reserved":0,"allocated":708608,"data_stored":281757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-06T03:35:17.680 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-06T03:35:17.680 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-06T03:35:17.680 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-06T03:35:17.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 shell --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 -- ceph health --format=json 2024-04-06T03:35:17.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: Regenerating cephadm self-signed grafana TLS certificates 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: Deploying daemon grafana.a on smithi102 2024-04-06T03:35:17.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:17 smithi102 ceph-mon[32821]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T03:35:17.959 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/mon.a/config 2024-04-06T03:35:18.493 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:18 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:18.311Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00021729s 2024-04-06T03:35:19.445 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:19 smithi047 ceph-mon[29365]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:19.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:19 smithi047 ceph-mon[37680]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:19.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:19 smithi102 ceph-mon[32821]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 -- 172.21.15.47:0/831369597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b806a920 msgr2=0x7f90b810f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 --2- 172.21.15.47:0/831369597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b806a920 0x7f90b810f160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009920 tx=0x7f90b0009c30 comp rx=0 tx=0).stop 2024-04-06T03:35:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 -- 172.21.15.47:0/831369597 shutdown_connections 2024-04-06T03:35:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 --2- 172.21.15.47:0/831369597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b806a920 0x7f90b810f160 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 --2- 172.21.15.47:0/831369597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90b8108320 0x7f90b8108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 --2- 172.21.15.47:0/831369597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90b8069f80 0x7f90b806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 -- 172.21.15.47:0/831369597 >> 172.21.15.47:0/831369597 conn(0x7f90b8078100 msgr2=0x7f90b8078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 -- 172.21.15.47:0/831369597 shutdown_connections 2024-04-06T03:35:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 -- 172.21.15.47:0/831369597 wait complete. 2024-04-06T03:35:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.893+0000 7f90bd413700 1 Processor -- start 2024-04-06T03:35:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90bd413700 1 -- start start 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90bd413700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b8069f80 0x7f90b8198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90bd413700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90b806a920 0x7f90b81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90bd413700 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90b8108320 0x7f90b819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90bd413700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f90b8111c70 con 0x7f90b8069f80 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90bd413700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f90b8111af0 con 0x7f90b806a920 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90bd413700 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f90b8111df0 con 0x7f90b8108320 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b6ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b8069f80 0x7f90b8198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b6ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b8069f80 0x7f90b8198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60474/0 (socket says 172.21.15.47:60474) 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b6ffd700 1 -- 172.21.15.47:0/3635967459 learned_addr learned my addr 172.21.15.47:0/3635967459 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b77fe700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90b8108320 0x7f90b819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b67fc700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90b806a920 0x7f90b81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b6ffd700 1 -- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90b8108320 msgr2=0x7f90b819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b6ffd700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90b8108320 0x7f90b819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b6ffd700 1 -- 172.21.15.47:0/3635967459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90b806a920 msgr2=0x7f90b81986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b6ffd700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90b806a920 0x7f90b81986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b6ffd700 1 -- 172.21.15.47:0/3635967459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b819d180 con 0x7f90b8069f80 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.894+0000 7f90b77fe700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90b8108320 0x7f90b819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.895+0000 7f90b6ffd700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b8069f80 0x7f90b8198170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90a800e3c0 tx=0x7f90a800e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.895+0000 7f90affff700 1 -- 172.21.15.47:0/3635967459 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a800ee40 con 0x7f90b8069f80 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.895+0000 7f90affff700 1 -- 172.21.15.47:0/3635967459 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f90a8003a00 con 0x7f90b8069f80 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.895+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b819d410 con 0x7f90b8069f80 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.895+0000 7f90affff700 1 -- 172.21.15.47:0/3635967459 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8004690 con 0x7f90b8069f80 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.895+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b81a4cf0 con 0x7f90b8069f80 2024-04-06T03:35:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.896+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b8068f90 con 0x7f90b8069f80 2024-04-06T03:35:19.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.897+0000 7f90affff700 1 -- 172.21.15.47:0/3635967459 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f90a801b030 con 0x7f90b8069f80 2024-04-06T03:35:19.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.897+0000 7f90affff700 1 --2- 172.21.15.47:0/3635967459 >> v2:172.21.15.47:6800/3359778320 conn(0x7f90a406dc00 0x7f90a40700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T03:35:19.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.897+0000 7f90affff700 1 -- 172.21.15.47:0/3635967459 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6259+0+0 (secure 0 0 0) 0x7f90a808d450 con 0x7f90b8069f80 2024-04-06T03:35:19.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.897+0000 7f90b67fc700 1 --2- 172.21.15.47:0/3635967459 >> v2:172.21.15.47:6800/3359778320 conn(0x7f90a406dc00 0x7f90a40700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T03:35:19.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.897+0000 7f90b67fc700 1 --2- 172.21.15.47:0/3635967459 >> v2:172.21.15.47:6800/3359778320 conn(0x7f90a406dc00 0x7f90a40700c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f90b8078930 tx=0x7f90a000b410 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T03:35:19.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:19.902+0000 7f90affff700 1 -- 172.21.15.47:0/3635967459 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f90a8022060 con 0x7f90b8069f80 2024-04-06T03:35:20.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.150+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f90b81a4ec0 con 0x7f90b8069f80 2024-04-06T03:35:20.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.151+0000 7f90affff700 1 -- 172.21.15.47:0/3635967459 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f90a8010040 con 0x7f90b8069f80 2024-04-06T03:35:20.153 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-06T03:35:20.153 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 >> v2:172.21.15.47:6800/3359778320 conn(0x7f90a406dc00 msgr2=0x7f90a40700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 --2- 172.21.15.47:0/3635967459 >> v2:172.21.15.47:6800/3359778320 conn(0x7f90a406dc00 0x7f90a40700c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f90b8078930 tx=0x7f90a000b410 comp rx=0 tx=0).stop 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b8069f80 msgr2=0x7f90b8198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b8069f80 0x7f90b8198170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90a800e3c0 tx=0x7f90a800e6d0 comp rx=0 tx=0).stop 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 shutdown_connections 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 --2- 172.21.15.47:0/3635967459 >> v2:172.21.15.47:6800/3359778320 conn(0x7f90a406dc00 0x7f90a40700c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90b8108320 0x7f90b819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90b8069f80 0x7f90b8198170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 --2- 172.21.15.47:0/3635967459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90b806a920 0x7f90b81986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 >> 172.21.15.47:0/3635967459 conn(0x7f90b8078100 msgr2=0x7f90b8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T03:35:20.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 shutdown_connections 2024-04-06T03:35:20.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-06T03:35:20.153+0000 7f90bd413700 1 -- 172.21.15.47:0/3635967459 wait complete. 2024-04-06T03:35:20.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3635967459' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-06T03:35:20.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:20.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3635967459' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-06T03:35:20.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:20.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3635967459' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-06T03:35:20.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:20.950 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-06T03:35:20.950 INFO:tasks.cephadm:Setup complete, yielding 2024-04-06T03:35:20.950 INFO:teuthology.run_tasks:Running task workunit... 2024-04-06T03:35:20.963 INFO:tasks.workunit:Pulling workunits from ref 584a67ccb9eb224c5312dccd96a82e67b0645518 2024-04-06T03:35:20.964 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-06T03:35:20.964 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-06T03:35:20.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T03:35:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-06T03:35:20.981 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-06T03:35:21.036 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-06T03:35:21.037 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-06T03:35:21.091 INFO:tasks.workunit:timeout=3h 2024-04-06T03:35:21.091 INFO:tasks.workunit:cleanup=True 2024-04-06T03:35:21.092 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 584a67ccb9eb224c5312dccd96a82e67b0645518 2024-04-06T03:35:21.147 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-06T03:35:21.717 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:21 smithi102 ceph-mon[32821]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:21.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:21 smithi047 ceph-mon[29365]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:21.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:21 smithi047 ceph-mon[37680]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:22.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:35:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:35:22.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:22 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:22.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:22 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:22.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:22 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:23.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:23 smithi047 ceph-mon[29365]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:23.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:23 smithi047 ceph-mon[37680]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:23.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:23 smithi102 ceph-mon[32821]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:35:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:35:25.718 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:25 smithi102 ceph-mon[32821]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:25.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:25 smithi047 ceph-mon[29365]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:25.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:25 smithi047 ceph-mon[37680]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:26.645 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:26 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:26.314Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003464387s 2024-04-06T03:35:27.619 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:27 smithi102 ceph-mon[32821]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:27.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:27 smithi047 ceph-mon[29365]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:27.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:27 smithi047 ceph-mon[37680]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:28.814 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 systemd[1]: Started Ceph grafana.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:35:29.065 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.812964228Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-04-06T03:35:29.065 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813123816Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-04-06T03:35:29.065 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813154247Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813159722Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813163911Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813167975Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813172476Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813175909Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813180066Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813186755Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813191301Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813195559Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813199742Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813204006Z level=info msg="Path Home" path=/usr/share/grafana 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813208336Z level=info msg="Path Data" path=/var/lib/grafana 2024-04-06T03:35:29.066 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813212006Z level=info msg="Path Logs" path=/var/log/grafana 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.813216Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.81322028Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=settings t=2024-04-06T03:35:28.81322492Z level=info msg="App mode production" 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore t=2024-04-06T03:35:28.813286241Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore t=2024-04-06T03:35:28.81334628Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.814598665Z level=info msg="Starting DB migrations" 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.814708745Z level=info msg="Executing migration" id="create migration_log table" 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.815641016Z level=info msg="Executing migration" id="create user table" 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.816178172Z level=info msg="Executing migration" id="add unique index user.login" 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.818791054Z level=info msg="Executing migration" id="add unique index user.email" 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.821525721Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.822103476Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-04-06T03:35:29.067 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.824945956Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.825780669Z level=info msg="Executing migration" id="create user table v2" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.826165448Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.828684903Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.829159288Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.829519774Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.829906397Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.830330776Z level=info msg="Executing migration" id="Update user table charset" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.830635101Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-04-06T03:35:29.068 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.831019873Z level=info msg="Executing migration" id="Add missing user data" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.831331549Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.831744535Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.832123942Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.832551076Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.833897817Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.834335222Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.834788804Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.835184498Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.835577756Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.835958017Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-04-06T03:35:29.070 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.836226018Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.836650066Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.837010456Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.83739956Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.839283856Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.84007938Z level=info msg="Executing migration" id="create temp_user v2" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.840482561Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.840918754Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.841302696Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.843662689Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.844079161Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.844411882Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.844744289Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.845049259Z level=info msg="Executing migration" id="create star table" 2024-04-06T03:35:29.071 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.845426215Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.845829748Z level=info msg="Executing migration" id="create org table v1" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.846201502Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.846608471Z level=info msg="Executing migration" id="create org_user table v1" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.846966302Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.847364211Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.847761948Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.848140092Z level=info msg="Executing migration" id="Update org table charset" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.850874Z level=info msg="Executing migration" id="Update org_user table charset" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.853429829Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.856136397Z level=info msg="Executing migration" id="create dashboard table" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.858818558Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.861536935Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-04-06T03:35:29.072 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.86422306Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.866860457Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.867831493Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.868455475Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.869513064Z level=info msg="Executing migration" id="create dashboard v2" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.870446909Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.871157213Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.871959198Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.872878573Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.873645674Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.874417879Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.875294351Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.87620324Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.876973922Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-04-06T03:35:29.073 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.877977184Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.878822609Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.879471615Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.880427084Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.881105254Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.881979293Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.882538722Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.883082742Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.883897514Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.884774328Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.885704162Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.886607Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.887388699Z level=info msg="Executing migration" id="Update dashboard title length" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.888376677Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-04-06T03:35:29.074 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.889208434Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.889953567Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.891042571Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.892011332Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.892899859Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.893644647Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.894487727Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.895343964Z level=info msg="Executing migration" id="Add check_sum column" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.896195536Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.897153639Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.899985538Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.902705205Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.905794188Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.908497501Z level=info msg="Executing migration" id="create data_source table" 2024-04-06T03:35:29.075 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.911319873Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.913748084Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.914254163Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.917101304Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.919857627Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.922521075Z level=info msg="Executing migration" id="create data_source table v2" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.925344679Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.928203523Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.931062992Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.933829782Z level=info msg="Executing migration" id="Add column with_credentials" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.936594618Z level=info msg="Executing migration" id="Add secure json data column" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.939258559Z level=info msg="Executing migration" id="Update data_source table charset" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.941958668Z level=info msg="Executing migration" id="Update initial version to 1" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.944773862Z level=info msg="Executing migration" id="Add read_only data column" 2024-04-06T03:35:29.076 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.947586329Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.950064332Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.952734547Z level=info msg="Executing migration" id="Add uid column" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.955412718Z level=info msg="Executing migration" id="Update uid value" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.958061148Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.960714155Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.963364621Z level=info msg="Executing migration" id="create api_key table" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.966127887Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.968717705Z level=info msg="Executing migration" id="add index api_key.key" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.9713928Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.974230918Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.97689869Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.977471804Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.980171198Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-04-06T03:35:29.077 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.982893567Z level=info msg="Executing migration" id="create api_key table v2" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.983292511Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.983677338Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.984061947Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.984496262Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.984802743Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.985128216Z level=info msg="Executing migration" id="Update api_key table charset" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.985411718Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.987980582Z level=info msg="Executing migration" id="Add service account foreign key" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.990932954Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.991538885Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.992107117Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.992972791Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.993582543Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-04-06T03:35:29.078 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.994348638Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.995169545Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.9958097Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.996541057Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.997269131Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.997573506Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.998277774Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.998882517Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:28.999468801Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.000215141Z level=info msg="Executing migration" id="create quota table v1" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.000599746Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.001317399Z level=info msg="Executing migration" id="Update quota table charset" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.002142739Z level=info msg="Executing migration" id="create plugin_setting table" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.002764002Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.003156257Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-04-06T03:35:29.079 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.003864395Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.004637228Z level=info msg="Executing migration" id="create session table" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.005465611Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.005878015Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.006564778Z level=info msg="Executing migration" id="create playlist table v2" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.006957475Z level=info msg="Executing migration" id="create playlist item table v2" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.007376565Z level=info msg="Executing migration" id="Update playlist table charset" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.0081293Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.008440756Z level=info msg="Executing migration" id="drop preferences table v2" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.009297203Z level=info msg="Executing migration" id="drop preferences table v3" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.009897392Z level=info msg="Executing migration" id="create preferences table v3" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.010691303Z level=info msg="Executing migration" id="Update preferences table charset" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.010982546Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.011701442Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.012579746Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-04-06T03:35:29.080 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.013322871Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.013934246Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.016673024Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.017136213Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.019633366Z level=info msg="Executing migration" id="create alert table v1" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.022393532Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.025093012Z level=info msg="Executing migration" id="add index alert state" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.027718028Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.036187635Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.036618232Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.037917609Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.039791365Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.041700436Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.043676997Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.045673798Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-04-06T03:35:29.081 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.047419113Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.049436414Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.051197388Z level=info msg="Executing migration" id="Add column is_default" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.051963617Z level=info msg="Executing migration" id="Add column frequency" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.053825524Z level=info msg="Executing migration" id="Add column send_reminder" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.05574759Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.0577565Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.058348971Z level=info msg="Executing migration" id="Update alert table charset" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.060424695Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.062156381Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.064035932Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.064597586Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.066467991Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-04-06T03:35:29.082 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.068334221Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-04-06T03:35:29.319 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.070207734Z level=info msg="Executing migration" id="Add for to alert table" 2024-04-06T03:35:29.319 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.070949619Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.072857378Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.07475658Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.076691805Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.077124867Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.079024615Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.080913996Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.082795906Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.083233536Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.085139416Z level=info msg="Executing migration" id="create annotation table v5" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.087037577Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.089036218Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.089537525Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.091425326Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-04-06T03:35:29.320 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.093425061Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-04-06T03:35:29.321 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.095105108Z level=info msg="Executing migration" id="Update annotation table charset" 2024-04-06T03:35:29.321 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.095425277Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-04-06T03:35:29.321 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.097336182Z level=info msg="Executing migration" id="Drop category_id index" 2024-04-06T03:35:29.321 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.099260376Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-04-06T03:35:29.321 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.101069397Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-04-06T03:35:29.321 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.102902607Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.104741096Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.1066168Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.108568776Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.108944454Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.111042887Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.113000088Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.114855625Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.115220862Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.117041055Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.118865962Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.120889788Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.121437655Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-04-06T03:35:29.322 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.123354544Z level=info msg="Executing migration" id="Add epoch_end column" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.125055317Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.127035555Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.127500303Z level=info msg="Executing migration" id="Move region to single row" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.129429326Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.131297802Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.133099214Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.133726755Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.135581869Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.137386703Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.139369198Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.139715975Z level=info msg="Executing migration" id="create test_data table" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.141582911Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.143515324Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.145274022Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-04-06T03:35:29.323 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.145734664Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.147718792Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.148069232Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.149610409Z level=info msg="Executing migration" id="create team table" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.150266194Z level=info msg="Executing migration" id="add index team.org_id" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.151529619Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.151963956Z level=info msg="Executing migration" id="create team member table" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.153931809Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.155722699Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.157638153Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.15808837Z level=info msg="Executing migration" id="Add column email to team table" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.159986402Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.162285489Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-04-06T03:35:29.324 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.164158704Z level=info msg="Executing migration" id="create dashboard acl table" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.164614069Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.166586622Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.168447871Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.17036442Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.170818376Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.173560441Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.174028659Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.174450844Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.174836282Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.175101169Z level=info msg="Executing migration" id="create tag table" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.175487885Z level=info msg="Executing migration" id="add index tag.key_value" 2024-04-06T03:35:29.325 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.175901121Z level=info msg="Executing migration" id="create login attempt table" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.176298799Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.176741357Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.177134886Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.179480475Z level=info msg="Executing migration" id="create login_attempt v2" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.179864837Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.180289157Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.18059996Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.180920777Z level=info msg="Executing migration" id="create user auth table" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.181280749Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.181713159Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.181969603Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.182784937Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-04-06T03:35:29.327 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.183612305Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.184459047Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.185341127Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.185764311Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.186620999Z level=info msg="Executing migration" id="create server_lock table" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.186997588Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.18743063Z level=info msg="Executing migration" id="create user auth token table" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.187843851Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.188265426Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.188682513Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.18909359Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.189967743Z level=info msg="Executing migration" id="create cache_data table" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.190414481Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.190842805Z level=info msg="Executing migration" id="create short_url table v1" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.191261902Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.192018243Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-04-06T03:35:29.328 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.192290484Z level=info msg="Executing migration" id="delete alert_definition table" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.19259672Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.193023124Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.193790974Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.194218246Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.194531949Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.194955262Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.195393817Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.195835019Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.196277695Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.197177393Z level=info msg="Executing migration" id="drop alert_definition table" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.197625848Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.197941908Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.19832957Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.198790307Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.199216527Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-04-06T03:35:29.329 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.199550942Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.200001078Z level=info msg="Executing migration" id="create alert_instance table" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.200419174Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.20084779Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.201285997Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.202158325Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.202615411Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.203053107Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.207377393Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.2116892Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.212149356Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.212932622Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.213913705Z level=info msg="Executing migration" id="create alert_rule table" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.214387845Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-04-06T03:35:29.330 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.215175437Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.215952745Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.216805427Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.21760824Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.218613705Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.219541095Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.220478879Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.221480897Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.222333547Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.223437009Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.224349628Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.225296381Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.226214641Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.227132824Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.228041011Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-04-06T03:35:29.331 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.228851833Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.22970894Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.230636966Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.231063652Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.232069228Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.233002195Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.233971372Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.234917352Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.235860554Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.23682704Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.237703388Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.23884447Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.239693396Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.240741669Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.241595797Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-04-06T03:35:29.332 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.242592275Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.243434455Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.246266678Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.24901538Z level=info msg="Executing migration" id="create provenance_type table" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.252020982Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.254763516Z level=info msg="Executing migration" id="create alert_image table" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.257329183Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.260118305Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.262750299Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.263165702Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.265517411Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.265588767Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.268335392Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.27098519Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.273840558Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-04-06T03:35:29.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.274025791Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.274160511Z level=info msg="alerts found to migrate" alerts=0 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.276813Z level=info msg="Executing migration" id="create library_element table v1" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.279433937Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.282217342Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.284895229Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.287690528Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.290546353Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.293330477Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.296205553Z level=info msg="Executing migration" id="create data_keys table" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.298788654Z level=info msg="Executing migration" id="create secrets table" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.30145047Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.306974751Z level=info msg="Executing migration" id="add name column into data_keys" 2024-04-06T03:35:29.334 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.309645569Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-04-06T03:35:29.335 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.312310687Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-04-06T03:35:29.335 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.317948887Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-04-06T03:35:29.572 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.326800469Z level=info msg="Executing migration" id="create kv_store table v1" 2024-04-06T03:35:29.572 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.329466586Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-04-06T03:35:29.572 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.332193265Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.334899163Z level=info msg="Executing migration" id="create permission table" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.335667637Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.338486468Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.341093441Z level=info msg="Executing migration" id="create role table" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.343881645Z level=info msg="Executing migration" id="add column display_name" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.346477854Z level=info msg="Executing migration" id="add column group_name" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.3492533Z level=info msg="Executing migration" id="add index role.org_id" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.351809622Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.352614989Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.35354911Z level=info msg="Executing migration" id="create team role table" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.35425991Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.356958594Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.3597336Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.362342819Z level=info msg="Executing migration" id="create user role table" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.365137859Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-04-06T03:35:29.573 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.367995213Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-04-06T03:35:29.574 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.370458644Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-04-06T03:35:29.574 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.373391584Z level=info msg="Executing migration" id="create builtin role table" 2024-04-06T03:35:29.574 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.375803861Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-04-06T03:35:29.574 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.378503761Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-04-06T03:35:29.574 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.381227308Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-04-06T03:35:29.574 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.383904297Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-04-06T03:35:29.574 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.386653793Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.389461975Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.392255067Z level=info msg="Executing migration" id="add unique index role.uid" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.394957014Z level=info msg="Executing migration" id="create seed assignment table" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.397642302Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.400451635Z level=info msg="Executing migration" id="add column hidden to role table" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.403039394Z level=info msg="Executing migration" id="create query_history table v1" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.405757604Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.408545293Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.409172267Z level=info msg="Executing migration" id="teams permissions migration" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.410076024Z level=info msg="Executing migration" id="dashboard permissions" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.410818314Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.411733208Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.412181266Z level=info msg="Executing migration" id="alerting notification permissions" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.412536356Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.413567095Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-04-06T03:35:29.575 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.414433802Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.415742658Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.41674003Z level=info msg="Executing migration" id="create correlation table v1" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.417454012Z level=info msg="Executing migration" id="add index correlations.uid" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.418458597Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.419151611Z level=info msg="Executing migration" id="add correlation config column" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.420309826Z level=info msg="Executing migration" id="create entity_events table" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.421147675Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.422116562Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.42230502Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.422819718Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.422894216Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.423741334Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.424556193Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.42546872Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-04-06T03:35:29.576 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.4262283Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-04-06T03:35:29.577 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.427173697Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-04-06T03:35:29.577 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.427917588Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-04-06T03:35:29.577 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.428848885Z level=info msg="Executing migration" id="Drop public config table" 2024-04-06T03:35:29.577 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.429346Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-04-06T03:35:29.577 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.429768776Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-04-06T03:35:29.577 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.430588145Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-04-06T03:35:29.577 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.431053321Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.431487571Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.435276894Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.436415235Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.437553918Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.4385145Z level=info msg="Executing migration" id="add share column" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.439748208Z level=info msg="Executing migration" id="create default alerting folders" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.440623449Z level=info msg="Executing migration" id="create file table" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.443482985Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.446211616Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.449329284Z level=info msg="Executing migration" id="create file_meta table" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.452271566Z level=info msg="Executing migration" id="file table idx: path key" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.455004676Z level=info msg="Executing migration" id="set path collation in file table" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.45764629Z level=info msg="Executing migration" id="managed permissions migration" 2024-04-06T03:35:29.578 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.460460566Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.463447035Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.466143898Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.46902259Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.471785928Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.474798764Z level=info msg="Executing migration" id="update group index for alert rules" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.477604652Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.480554239Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.484142286Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.486953699Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.489991402Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.493461496Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.50656242Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.509392492Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.512209482Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.516640542Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-04-06T03:35:29.579 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.519604699Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.522346342Z level=info msg="Executing migration" id="create folder table" 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.524985104Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.527823229Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.530477553Z level=info msg="Executing migration" id="Update folder title length" 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.533302129Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=migrator t=2024-04-06T03:35:29.536234012Z level=info msg="migrations completed" performed=485 skipped=0 duration=721.560635ms 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore t=2024-04-06T03:35:29.536835741Z level=info msg="Created default organization" 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=plugin.finder t=2024-04-06T03:35:29.571125415Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-04-06T03:35:29.580 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=secrets t=2024-04-06T03:35:29.571230584Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-04-06T03:35:29.834 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=query_data t=2024-04-06T03:35:29.575309141Z level=info msg="Query Service initialization" 2024-04-06T03:35:29.834 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=live.push_http t=2024-04-06T03:35:29.577783529Z level=info msg="Live Push Gateway initialization" 2024-04-06T03:35:29.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-mon[32821]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:29.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:29.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:29.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:29.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:29.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:29 smithi102 ceph-mon[32821]: Deploying daemon node-exporter.a on smithi047 2024-04-06T03:35:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[29365]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[29365]: Deploying daemon node-exporter.a on smithi047 2024-04-06T03:35:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[37680]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:29 smithi047 ceph-mon[37680]: Deploying daemon node-exporter.a on smithi047 2024-04-06T03:35:30.245 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:30 smithi047 bash[72866]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-04-06T03:35:30.584 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=infra.usagestats.collector t=2024-04-06T03:35:30.175289322Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=provisioning.datasources t=2024-04-06T03:35:30.177580532Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=provisioning.datasources t=2024-04-06T03:35:30.188911173Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=provisioning.alerting t=2024-04-06T03:35:30.199490073Z level=info msg="starting to provision alerting" 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=provisioning.alerting t=2024-04-06T03:35:30.199500871Z level=info msg="finished to provision alerting" 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=ngalert.state.manager t=2024-04-06T03:35:30.19960789Z level=info msg="Warming state cache for startup" 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=ngalert.state.manager t=2024-04-06T03:35:30.199755572Z level=info msg="State cache has been initialized" states=0 duration=146.808µs 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=ticker t=2024-04-06T03:35:30.199807124Z level=info msg=starting first_tick=2024-04-06T03:35:40Z 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=ngalert.multiorg.alertmanager t=2024-04-06T03:35:30.200189481Z level=info msg="starting MultiOrg Alertmanager" 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=grafanaStorageLogger t=2024-04-06T03:35:30.200230359Z level=info msg="storage starting" 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=http.server t=2024-04-06T03:35:30.201616746Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore.transactions t=2024-04-06T03:35:30.221334866Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore.transactions t=2024-04-06T03:35:30.232980789Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore.transactions t=2024-04-06T03:35:30.243703407Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-04-06T03:35:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore.transactions t=2024-04-06T03:35:30.254009875Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=3 code="database is locked" 2024-04-06T03:35:30.586 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore.transactions t=2024-04-06T03:35:30.265100028Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-04-06T03:35:30.586 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore.transactions t=2024-04-06T03:35:30.275546135Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-04-06T03:35:30.586 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:35:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore.transactions t=2024-04-06T03:35:30.285979528Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-04-06T03:35:31.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:31 smithi047 ceph-mon[29365]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:31.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:31 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:31 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:31.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:31 smithi047 ceph-mon[37680]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:31.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:31 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:31.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:31 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:31.494 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:31 smithi047 bash[72866]: Getting image source signatures 2024-04-06T03:35:31.494 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:31 smithi047 bash[72866]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-04-06T03:35:31.494 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:31 smithi047 bash[72866]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-04-06T03:35:31.494 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:31 smithi047 bash[72866]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-04-06T03:35:31.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:31 smithi102 ceph-mon[32821]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:31.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:31 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:31.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:31 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:32.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:35:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:35:32.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:32 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:32.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:32 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:32.744 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:32 smithi047 bash[72866]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-04-06T03:35:32.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:32 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:33.218 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:32 smithi047 bash[72866]: Writing manifest to image destination 2024-04-06T03:35:33.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-mon[29365]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:33.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-mon[37680]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:33.494 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 podman[72866]: 2024-04-06 03:35:33.216560481 +0000 UTC m=+3.313202714 container create 17bf4fcef0258c487685ccbc7dada888893196169e206db550d3c92f35267fb4 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:33.494 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 podman[72866]: 2024-04-06 03:35:33.135149622 +0000 UTC m=+3.231791858 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 podman[72866]: 2024-04-06 03:35:33.393424152 +0000 UTC m=+3.490066385 container init 17bf4fcef0258c487685ccbc7dada888893196169e206db550d3c92f35267fb4 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 podman[72866]: 2024-04-06 03:35:33.396484045 +0000 UTC m=+3.493126281 container start 17bf4fcef0258c487685ccbc7dada888893196169e206db550d3c92f35267fb4 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.401Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.401Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.401Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.401Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.401Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=arp 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=bcache 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=bonding 2024-04-06T03:35:33.495 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=btrfs 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=conntrack 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=cpu 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=diskstats 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=dmi 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=edac 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=entropy 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=filefd 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=filesystem 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=hwmon 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=infiniband 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=ipvs 2024-04-06T03:35:33.496 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=loadavg 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=mdadm 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=meminfo 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=netclass 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=netdev 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=netstat 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=nfs 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=nfsd 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=nvme 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=os 2024-04-06T03:35:33.497 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=pressure 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=rapl 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=schedstat 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=selinux 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=sockstat 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=softnet 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=stat 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=tapestats 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=textfile 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=time 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=uname 2024-04-06T03:35:33.498 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.402Z caller=node_exporter.go:117 level=info collector=vmstat 2024-04-06T03:35:33.499 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.403Z caller=node_exporter.go:117 level=info collector=xfs 2024-04-06T03:35:33.499 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.403Z caller=node_exporter.go:117 level=info collector=zfs 2024-04-06T03:35:33.499 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.403Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-04-06T03:35:33.499 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a[72916]: ts=2024-04-06T03:35:33.403Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-04-06T03:35:33.499 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 bash[72866]: 17bf4fcef0258c487685ccbc7dada888893196169e206db550d3c92f35267fb4 2024-04-06T03:35:33.773 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 03:35:33 smithi047 systemd[1]: Started Ceph node-exporter.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:35:33.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:33 smithi102 ceph-mon[32821]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:34.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:35:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:35:34.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:34 smithi102 ceph-mon[32821]: Deploying daemon node-exporter.b on smithi102 2024-04-06T03:35:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:34 smithi047 ceph-mon[37680]: Deploying daemon node-exporter.b on smithi102 2024-04-06T03:35:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:34 smithi047 ceph-mon[29365]: Deploying daemon node-exporter.b on smithi102 2024-04-06T03:35:35.470 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:35 smithi102 systemd[1]: Starting Ceph node-exporter.b for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:35:35.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:35 smithi047 ceph-mon[29365]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:35.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:35 smithi047 ceph-mon[37680]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:35 smithi102 ceph-mon[32821]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:36.085 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:35 smithi102 bash[63733]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-04-06T03:35:36.584 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:36 smithi102 bash[63733]: Getting image source signatures 2024-04-06T03:35:36.584 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:36 smithi102 bash[63733]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-04-06T03:35:36.584 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:36 smithi102 bash[63733]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-04-06T03:35:36.584 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:36 smithi102 bash[63733]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-04-06T03:35:37.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:37 smithi047 ceph-mon[29365]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:37.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:37 smithi047 ceph-mon[37680]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:38.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:37 smithi102 ceph-mon[32821]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:38.084 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:37 smithi102 bash[63733]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-04-06T03:35:38.084 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:37 smithi102 bash[63733]: Writing manifest to image destination 2024-04-06T03:35:38.449 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 podman[63733]: 2024-04-06 03:35:38.187005446 +0000 UTC m=+2.618644987 container create b52dea25f4f545635b769a3fe7c6ad328e5c024dcae0d4046b959a68809c6e4c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-04-06T03:35:38.449 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 podman[63733]: 2024-04-06 03:35:38.105206846 +0000 UTC m=+2.536846399 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 podman[63733]: 2024-04-06 03:35:38.372801186 +0000 UTC m=+2.804440730 container init b52dea25f4f545635b769a3fe7c6ad328e5c024dcae0d4046b959a68809c6e4c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 podman[63733]: 2024-04-06 03:35:38.375492412 +0000 UTC m=+2.807131956 container start b52dea25f4f545635b769a3fe7c6ad328e5c024dcae0d4046b959a68809c6e4c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.380Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.380Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.380Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.380Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-04-06T03:35:38.450 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=arp 2024-04-06T03:35:38.451 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=bcache 2024-04-06T03:35:38.451 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=bonding 2024-04-06T03:35:38.451 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=btrfs 2024-04-06T03:35:38.451 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=conntrack 2024-04-06T03:35:38.451 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=cpu 2024-04-06T03:35:38.451 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-04-06T03:35:38.451 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=diskstats 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=dmi 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=edac 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=entropy 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=filefd 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=filesystem 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=hwmon 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=infiniband 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=ipvs 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=loadavg 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=mdadm 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=meminfo 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=netclass 2024-04-06T03:35:38.452 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=netdev 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=netstat 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=nfs 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=nfsd 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=nvme 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=os 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=pressure 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=rapl 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=schedstat 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=selinux 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=sockstat 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=softnet 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=stat 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=tapestats 2024-04-06T03:35:38.453 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=textfile 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=time 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=uname 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=vmstat 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=xfs 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=node_exporter.go:117 level=info collector=zfs 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b[63782]: ts=2024-04-06T03:35:38.381Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-04-06T03:35:38.454 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 bash[63733]: b52dea25f4f545635b769a3fe7c6ad328e5c024dcae0d4046b959a68809c6e4c 2024-04-06T03:35:38.834 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 03:35:38 smithi102 systemd[1]: Started Ceph node-exporter.b for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:35:39.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:39 smithi102 ceph-mon[32821]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:39.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:39 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:39 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:39 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:39 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:39 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:39 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:35:39.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[29365]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:39.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[37680]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:39 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:35:41.740 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:41 smithi102 ceph-mon[32821]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:41.740 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:41 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:41.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:41 smithi047 ceph-mon[29365]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:41.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:41 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:41.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:41 smithi047 ceph-mon[37680]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:41.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:41 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:42.004 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:35:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:35:43.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:42 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:43.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:42 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:43.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:42 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:43.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:42 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:43.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:42 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:43.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:42 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:43.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:42 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:43.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:42 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:43.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:42 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.233 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:35:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[37680]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[29365]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:43 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:43 smithi102 ceph-mon[32821]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:44.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:43 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:43 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:44.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:43 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:44.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:43 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:44.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:43 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:44 smithi047 ceph-mon[29365]: Reconfiguring alertmanager.a (dependencies changed)... 2024-04-06T03:35:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:44 smithi047 ceph-mon[29365]: Reconfiguring daemon alertmanager.a on smithi047 2024-04-06T03:35:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:44 smithi047 ceph-mon[37680]: Reconfiguring alertmanager.a (dependencies changed)... 2024-04-06T03:35:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:44 smithi047 ceph-mon[37680]: Reconfiguring daemon alertmanager.a on smithi047 2024-04-06T03:35:45.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:44 smithi102 ceph-mon[32821]: Reconfiguring alertmanager.a (dependencies changed)... 2024-04-06T03:35:45.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:44 smithi102 ceph-mon[32821]: Reconfiguring daemon alertmanager.a on smithi047 2024-04-06T03:35:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:45 smithi047 ceph-mon[29365]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:45 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:45 smithi047 ceph-mon[37680]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:45 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:46.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:45 smithi102 ceph-mon[32821]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:46.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:45 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:35:47.194 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:46 smithi047 systemd[1]: Stopping Ceph alertmanager.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:35:47.487 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:47 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[72321]: ts=2024-04-06T03:35:47.193Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-04-06T03:35:47.487 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:47 smithi047 podman[73626]: 2024-04-06 03:35:47.213796114 +0000 UTC m=+0.131335855 container died 4b9662201f0a50bbf65c06e02126fe24a913aba2130c254590b6a9f7bd7b9e1e (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:47.743 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:47 smithi047 podman[73626]: 2024-04-06 03:35:47.593322472 +0000 UTC m=+0.510862217 container cleanup 4b9662201f0a50bbf65c06e02126fe24a913aba2130c254590b6a9f7bd7b9e1e (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:47.743 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:47 smithi047 bash[73626]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a 2024-04-06T03:35:48.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:47 smithi047 ceph-mon[29365]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:48.147 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:47 smithi047 ceph-mon[37680]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:48.147 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:47 smithi047 podman[73640]: 2024-04-06 03:35:47.861283956 +0000 UTC m=+0.647589019 container remove 4b9662201f0a50bbf65c06e02126fe24a913aba2130c254590b6a9f7bd7b9e1e (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:48.148 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:47 smithi047 podman[73640]: 2024-04-06 03:35:47.945369862 +0000 UTC m=+0.731674934 volume remove 8ff88e0ab4843c676ea1974daa7fdcc0b61de6eb49e3a12d9090ccbda3704205 2024-04-06T03:35:48.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:47 smithi102 ceph-mon[32821]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:48.456 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-04-06T03:35:48.456 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 systemd[1]: Stopped Ceph alertmanager.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:35:48.456 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 systemd[1]: Starting Ceph alertmanager.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:35:48.456 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 podman[73736]: 2024-04-06 03:35:48.354722675 +0000 UTC m=+0.100103162 volume create e01c6e7938eff51c568e1ab7571950ee9ab1977917f6ca9b2be5a767f58eacef 2024-04-06T03:35:48.456 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 podman[73736]: 2024-04-06 03:35:48.273046588 +0000 UTC m=+0.018427038 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-04-06T03:35:48.456 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 podman[73736]: 2024-04-06 03:35:48.455160331 +0000 UTC m=+0.200540762 container create e003083d9a03c84adaf832490343c051583aff8dcc7c3131c9a59e8258b8f371 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:49.243 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 podman[73736]: 2024-04-06 03:35:48.766801374 +0000 UTC m=+0.512181808 container init e003083d9a03c84adaf832490343c051583aff8dcc7c3131c9a59e8258b8f371 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 podman[73736]: 2024-04-06 03:35:48.76948183 +0000 UTC m=+0.514862256 container start e003083d9a03c84adaf832490343c051583aff8dcc7c3131c9a59e8258b8f371 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:48.782Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:48.782Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:48.783Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.47 port=9094 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:48.784Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:48.808Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:48.808Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:48.812Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:48.812Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 bash[73736]: e003083d9a03c84adaf832490343c051583aff8dcc7c3131c9a59e8258b8f371 2024-04-06T03:35:49.244 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:48 smithi047 systemd[1]: Started Ceph alertmanager.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:35:50.030 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:49 smithi102 ceph-mon[32821]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:50.031 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:50.031 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:50.031 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:49 smithi102 ceph-mon[32821]: Reconfiguring prometheus.a (dependencies changed)... 2024-04-06T03:35:50.173 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:49 smithi047 ceph-mon[29365]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:50.173 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:50.173 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:50.173 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:49 smithi047 ceph-mon[29365]: Reconfiguring prometheus.a (dependencies changed)... 2024-04-06T03:35:50.174 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:49 smithi047 ceph-mon[37680]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:50.174 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:50.174 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:50.174 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:49 smithi047 ceph-mon[37680]: Reconfiguring prometheus.a (dependencies changed)... 2024-04-06T03:35:51.151 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:50 smithi047 ceph-mon[29365]: Reconfiguring daemon prometheus.a on smithi102 2024-04-06T03:35:51.151 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:50 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:50.785Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.001016131s 2024-04-06T03:35:51.151 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:50 smithi047 ceph-mon[37680]: Reconfiguring daemon prometheus.a on smithi102 2024-04-06T03:35:51.203 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:50 smithi102 ceph-mon[32821]: Reconfiguring daemon prometheus.a on smithi102 2024-04-06T03:35:52.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:35:51 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:35:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:51 smithi102 ceph-mon[32821]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:52.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:51 smithi047 ceph-mon[29365]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:52.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:51 smithi047 ceph-mon[37680]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:52.556 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 systemd[1]: Stopping Ceph prometheus.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:35:52.816 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.554Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-04-06T03:35:52.816 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[61450]: ts=2024-04-06T03:35:52.555Z caller=main.go:1147 level=info msg="See you next time!" 2024-04-06T03:35:52.817 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 podman[64686]: 2024-04-06 03:35:52.564973668 +0000 UTC m=+0.111047850 container died e6614b2849f6739d3de1c2d32d781b1b602246edf4a6cc1b53cb1f49d94acfcc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:53.084 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 podman[64686]: 2024-04-06 03:35:52.929983424 +0000 UTC m=+0.476057651 container cleanup e6614b2849f6739d3de1c2d32d781b1b602246edf4a6cc1b53cb1f49d94acfcc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:53.084 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:52 smithi102 bash[64686]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a 2024-04-06T03:35:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:52 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:53.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:52 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:53.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:52 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:35:53.558 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 podman[64701]: 2024-04-06 03:35:53.222696992 +0000 UTC m=+0.660321512 container remove e6614b2849f6739d3de1c2d32d781b1b602246edf4a6cc1b53cb1f49d94acfcc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:53.558 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-04-06T03:35:53.558 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 systemd[1]: Stopped Ceph prometheus.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:35:53.559 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@prometheus.a.service: Consumed 1.037s CPU time. 2024-04-06T03:35:53.559 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 systemd[1]: Starting Ceph prometheus.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 podman[64793]: 2024-04-06 03:35:53.461213476 +0000 UTC m=+0.019230917 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 podman[64793]: 2024-04-06 03:35:53.565305103 +0000 UTC m=+0.123322586 container create d6e1677b94e49586b86ba1a69aa95959ec9bcbb67ae989f3e09763ed2128d229 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 podman[64793]: 2024-04-06 03:35:53.74219643 +0000 UTC m=+0.300213871 container init d6e1677b94e49586b86ba1a69aa95959ec9bcbb67ae989f3e09763ed2128d229 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 podman[64793]: 2024-04-06 03:35:53.744655212 +0000 UTC m=+0.302672655 container start d6e1677b94e49586b86ba1a69aa95959ec9bcbb67ae989f3e09763ed2128d229 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.768Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.768Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.768Z caller=main.go:570 level=info host_details="(Linux 5.14.0-432.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Mar 20 20:26:59 UTC 2024 x86_64 smithi102 (none))" 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.768Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.768Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.769Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.770Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-04-06T03:35:53.827 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.770Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.770Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.772Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.772Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.425µs 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.772Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.772Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.773Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.773Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=16.618µs wal_replay_duration=1.610045ms wbl_replay_duration=356ns total_replay_duration=1.643558ms 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.774Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.774Z caller=main.go:1029 level=info msg="TSDB started" 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.774Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.791Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=17.015051ms db_storage=669ns remote_storage=1.116µs web_handler=360ns query_engine=504ns scrape=364.811µs scrape_sd=84.354µs notify=15.515µs notify_sd=20.666µs rules=16.323201ms tracing=5.156µs 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.791Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-04-06T03:35:53.828 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T03:35:53.791Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-04-06T03:35:53.829 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 bash[64793]: d6e1677b94e49586b86ba1a69aa95959ec9bcbb67ae989f3e09763ed2128d229 2024-04-06T03:35:54.084 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 03:35:53 smithi102 systemd[1]: Started Ceph prometheus.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T03:35:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T03:35:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T03:35:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T03:35:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi102.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T03:35:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.225 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi102.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:54.226 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi102.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:53] ENGINE Bus STOPPING 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:53] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:53] ENGINE Bus STOPPED 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:53] ENGINE Bus STARTING 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:53] ENGINE Serving on http://:::9283 2024-04-06T03:35:54.227 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:53] ENGINE Bus STARTED 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:53] ENGINE Bus STOPPING 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Bus STOPPED 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Bus STARTING 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Serving on http://:::9283 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Bus STARTED 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Bus STOPPING 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Bus STOPPED 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Bus STARTING 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Serving on http://:::9283 2024-04-06T03:35:54.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:03:35:54] ENGINE Bus STARTED 2024-04-06T03:35:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T03:35:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T03:35:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T03:35:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi102.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T03:35:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T03:35:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T03:35:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi102.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T03:35:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi102.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T03:35:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:54 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:35:55.130 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T03:35:55.130 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi102.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi102.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi102.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:35:55.131 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi047.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi102.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi102.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi102.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:55.132 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:54 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:35:56.209 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:55 smithi047 ceph-mon[29365]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:56.209 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:55 smithi047 ceph-mon[37680]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:56.293 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:55 smithi102 ceph-mon[32821]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:58.032 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:57 smithi102 ceph-mon[32821]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:58.032 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:57 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:58.033 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:57 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:57 smithi047 ceph-mon[29365]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:57 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:57 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:57 smithi047 ceph-mon[37680]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:35:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:57 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:57 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.243 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 03:35:58 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T03:35:58.788Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.004034802s 2024-04-06T03:35:59.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[29365]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:59.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[37680]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:35:59 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:59 smithi102 ceph-mon[32821]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:35:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:59 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:59 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:35:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:59 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:35:59.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:59 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:35:59.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:35:59 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:36:01.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:01 smithi047 ceph-mon[29365]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:01.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:01 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:01.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:01 smithi047 ceph-mon[37680]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:01.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:01 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:01.745 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:01 smithi102 ceph-mon[32821]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:01.745 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:01 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:02.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:36:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:36:02.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:02 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:02.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:02 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:02.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:02 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:03.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:03 smithi047 ceph-mon[37680]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:03.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:03 smithi047 ceph-mon[29365]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:03 smithi102 ceph-mon[32821]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:04.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:36:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:36:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:36:05.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:05 smithi047 ceph-mon[29365]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:05.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:05 smithi047 ceph-mon[37680]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:05 smithi102 ceph-mon[32821]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:07.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:07 smithi047 ceph-mon[29365]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:07.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:07 smithi047 ceph-mon[37680]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:07.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:07 smithi102 ceph-mon[32821]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:09.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:09 smithi047 ceph-mon[37680]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:09.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:09 smithi047 ceph-mon[29365]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:09.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:09 smithi102 ceph-mon[32821]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:11.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:11 smithi047 ceph-mon[37680]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:11.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:11 smithi047 ceph-mon[29365]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:11.755 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:11 smithi102 ceph-mon[32821]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:12.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:36:11 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:36:12.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:12 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:12 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:12 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:13.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:13 smithi047 ceph-mon[29365]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:13.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:13 smithi047 ceph-mon[37680]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:13 smithi102 ceph-mon[32821]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:14.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:36:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:36:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:36:15.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:15 smithi047 ceph-mon[29365]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:15.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:15 smithi047 ceph-mon[37680]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:15.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:15 smithi102 ceph-mon[32821]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:16.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:16 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:16.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:16 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:16.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:16 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:17.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:17 smithi047 ceph-mon[29365]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:17.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:17 smithi047 ceph-mon[37680]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:17.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:17 smithi102 ceph-mon[32821]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:19.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:19 smithi047 ceph-mon[29365]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:19.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:19 smithi047 ceph-mon[37680]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:19.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:19 smithi102 ceph-mon[32821]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:21.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:21 smithi047 ceph-mon[29365]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:21.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:21 smithi047 ceph-mon[37680]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:21.763 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:21 smithi102 ceph-mon[32821]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:22.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:36:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:36:22.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:22 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:22 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:22.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:22 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:23.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:23 smithi047 ceph-mon[29365]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:23.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:23 smithi047 ceph-mon[37680]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:23.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:23 smithi102 ceph-mon[32821]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:36:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:36:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:36:25.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:25 smithi047 ceph-mon[29365]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:25.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:25 smithi047 ceph-mon[37680]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:25.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:25 smithi102 ceph-mon[32821]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:27.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:27 smithi047 ceph-mon[29365]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:27.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:27 smithi047 ceph-mon[37680]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:27.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:27 smithi102 ceph-mon[32821]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:28.711 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 98% (12240/12461) Updating files: 99% (12337/12461) Updating files: 100% (12461/12461) Updating files: 100% (12461/12461), done. 2024-04-06T03:36:29.408 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to '584a67ccb9eb224c5312dccd96a82e67b0645518'. 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-04-06T03:36:29.409 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-06T03:36:29.410 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-04-06T03:36:29.410 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-06T03:36:29.410 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-06T03:36:29.410 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-06T03:36:29.410 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at 584a67ccb9e Merge pull request #56706 from afreen23/wip-65208-squid 2024-04-06T03:36:29.413 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-06T03:36:29.443 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-06T03:36:29.445 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-06T03:36:29.445 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-06T03:36:29.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:29 smithi047 ceph-mon[29365]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:29.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:29 smithi047 ceph-mon[37680]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:29.831 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:29 smithi102 ceph-mon[32821]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:30.296 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-06T03:36:30.372 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-06T03:36:30.414 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-06T03:36:30.416 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-06T03:36:30.416 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-06T03:36:30.456 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-06T03:36:30.459 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-06T03:36:30.459 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-06T03:36:30.518 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-04-06T03:36:30.520 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-04-06T03:36:30.520 DEBUG:teuthology.orchestra.run.smithi047:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=584a67ccb9eb224c5312dccd96a82e67b0645518 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-04-06T03:36:30.587 INFO:tasks.workunit.client.0.smithi047.stderr:+ parallel=1 2024-04-06T03:36:30.587 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' '' = --serial ']' 2024-04-06T03:36:30.587 INFO:tasks.workunit.client.0.smithi047.stderr:+ crimson=0 2024-04-06T03:36:30.587 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' '' = --crimson ']' 2024-04-06T03:36:30.587 INFO:tasks.workunit.client.0.smithi047.stderr:+ color= 2024-04-06T03:36:30.587 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -t 1 ']' 2024-04-06T03:36:30.588 INFO:tasks.workunit.client.0.smithi047.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-04-06T03:36:30.588 INFO:tasks.workunit.client.0.smithi047.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-06T03:36:30.588 INFO:tasks.workunit.client.0.smithi047.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-06T03:36:30.589 INFO:tasks.workunit.client.0.smithi047.stderr:+ declare -A pids 2024-04-06T03:36:30.589 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.589 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.589 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_aio 2024-04-06T03:36:30.589 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_aio' 2024-04-06T03:36:30.589 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_aio 2024-04-06T03:36:30.589 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.590 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_aio 2024-04-06T03:36:30.590 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74408 2024-04-06T03:36:30.590 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_aio on pid 74408' 2024-04-06T03:36:30.591 INFO:tasks.workunit.client.0.smithi047.stdout:test api_aio on pid 74408 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74408 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_aio_pp 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_aio_pp' 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_aio_pp 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.594 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.595 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_aio_pp 2024-04-06T03:36:30.596 INFO:tasks.workunit.client.0.smithi047.stdout:test api_aio_pp on pid 74415 2024-04-06T03:36:30.600 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74415 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_aio_pp on pid 74415' 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74415 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_io 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_io' 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_io 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.601 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.602 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_io 2024-04-06T03:36:30.604 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74424 2024-04-06T03:36:30.605 INFO:tasks.workunit.client.0.smithi047.stdout:test api_io on pid 74424 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_io on pid 74424' 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74424 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_io_pp 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_io_pp' 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_io_pp 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.611 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.612 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.613 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_io_pp 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74435 2024-04-06T03:36:30.614 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_io_pp on pid 74435' 2024-04-06T03:36:30.615 INFO:tasks.workunit.client.0.smithi047.stdout:test api_io_pp on pid 74435 2024-04-06T03:36:30.619 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74435 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_asio 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_asio' 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_asio 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.620 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.621 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.622 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.623 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.624 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.625 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.626 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.626 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.626 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.626 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_asio 2024-04-06T03:36:30.626 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.626 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.626 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.626 INFO:tasks.workunit.client.0.smithi047.stdout:test api_asio on pid 74449 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74449 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_asio on pid 74449' 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74449 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_list 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_list' 2024-04-06T03:36:30.630 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_list 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.631 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.632 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.633 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.634 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.635 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.636 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74408/exe 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_list 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74468 2024-04-06T03:36:30.637 INFO:tasks.workunit.client.0.smithi047.stdout:test api_list on pid 74468 2024-04-06T03:36:30.643 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_list on pid 74468' 2024-04-06T03:36:30.643 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74468 2024-04-06T03:36:30.643 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.643 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.643 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.643 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_lock 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_lock' 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.644 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_lock 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.645 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_aio.log 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.646 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.647 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_aio: /' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.648 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.649 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.650 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74415/exe 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_lock 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74487 2024-04-06T03:36:30.651 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_lock on pid 74487' 2024-04-06T03:36:30.652 INFO:tasks.workunit.client.0.smithi047.stdout:test api_lock on pid 74487 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74487 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_lock_pp 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_lock_pp' 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_lock_pp 2024-04-06T03:36:30.657 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.658 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.659 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.660 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_aio_pp: /' 2024-04-06T03:36:30.661 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.662 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74424/exe 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.663 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.664 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_lock_pp 2024-04-06T03:36:30.665 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74507 2024-04-06T03:36:30.666 INFO:tasks.workunit.client.0.smithi047.stdout:test api_lock_pp on pid 74507 2024-04-06T03:36:30.669 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_lock_pp on pid 74507' 2024-04-06T03:36:30.669 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74507 2024-04-06T03:36:30.669 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_misc 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_misc' 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.670 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.671 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_io.log 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.672 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.673 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.674 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_io: /' 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.675 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_misc 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.676 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_misc 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.677 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.678 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74527 2024-04-06T03:36:30.678 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_misc on pid 74527' 2024-04-06T03:36:30.678 INFO:tasks.workunit.client.0.smithi047.stdout:test api_misc on pid 74527 2024-04-06T03:36:30.679 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74527 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_misc_pp 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_misc_pp' 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_misc_pp 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.680 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.681 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74435/exe 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.682 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.683 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.684 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.685 INFO:tasks.workunit.client.0.smithi047.stdout:test api_misc_pp on pid 74540 2024-04-06T03:36:30.689 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_misc_pp 2024-04-06T03:36:30.689 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74540 2024-04-06T03:36:30.689 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_misc_pp on pid 74540' 2024-04-06T03:36:30.689 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74540 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.690 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_tier_pp 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.691 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_tier_pp' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_io_pp: /' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74449/exe 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.692 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.693 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.694 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_tier_pp 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.695 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.696 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_asio: /' 2024-04-06T03:36:30.697 INFO:tasks.workunit.client.0.smithi047.stdout:test api_tier_pp on pid 74564 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_tier_pp 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74564 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_tier_pp on pid 74564' 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74564 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.705 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.706 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.707 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_asio.log 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.708 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.709 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.710 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.711 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.712 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.713 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.714 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.715 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74487/exe 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_pool 2024-04-06T03:36:30.716 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_pool' 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74468/exe 2024-04-06T03:36:30.717 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_lock.log 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_lock: /' 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.718 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-04-06T03:36:30.719 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_list.log 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_list: /' 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.720 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.721 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74507/exe 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_pool 2024-04-06T03:36:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.726 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.726 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.726 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.726 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.726 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.726 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.726 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.727 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_lock_pp: /' 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.728 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.729 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.730 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.731 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.732 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.733 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.734 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.734 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.734 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.734 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.734 INFO:tasks.workunit.client.0.smithi047.stdout:test api_pool on pid 74634 2024-04-06T03:36:30.737 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_pool 2024-04-06T03:36:30.737 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74634 2024-04-06T03:36:30.737 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_pool on pid 74634' 2024-04-06T03:36:30.737 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74634 2024-04-06T03:36:30.737 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.737 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.737 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.737 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_snapshots 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_snapshots' 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.738 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.739 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74527/exe 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.740 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74564/exe 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.741 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_snapshots 2024-04-06T03:36:30.742 INFO:tasks.workunit.client.0.smithi047.stdout:test api_snapshots on pid 74669 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_snapshots 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74669 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_snapshots on pid 74669' 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74669 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_snapshots_pp 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_snapshots_pp' 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.744 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74540/exe 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.745 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.746 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.747 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_misc.log 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.748 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.749 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-04-06T03:36:30.749 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_misc_pp: /' 2024-04-06T03:36:30.749 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-04-06T03:36:30.749 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_snapshots_pp 2024-04-06T03:36:30.749 INFO:tasks.workunit.client.0.smithi047.stdout:test api_snapshots_pp on pid 74702 2024-04-06T03:36:30.753 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_snapshots_pp 2024-04-06T03:36:30.753 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74702 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_snapshots_pp on pid 74702' 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74702 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_stat 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_stat' 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.754 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_stat 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.755 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_tier_pp: /' 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.756 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.757 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_misc: /' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.758 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.759 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.759 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.759 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.759 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.759 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.759 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.759 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.759 INFO:tasks.workunit.client.0.smithi047.stdout:test api_stat on pid 74729 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_stat 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74729 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_stat on pid 74729' 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74729 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.763 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_stat_pp 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_stat_pp' 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.764 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_stat_pp 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.765 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.766 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.767 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.768 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.769 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.770 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.771 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.771 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.771 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.771 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.771 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.771 INFO:tasks.workunit.client.0.smithi047.stdout:test api_stat_pp on pid 74756 2024-04-06T03:36:30.773 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_stat_pp 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74756 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_stat_pp on pid 74756' 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74756 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.774 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.775 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.776 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.777 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.778 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.779 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74702/exe 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_watch_notify 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_watch_notify' 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.780 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74669/exe 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_watch_notify 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.781 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.782 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.783 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.784 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.785 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_snapshots: /' 2024-04-06T03:36:30.786 INFO:tasks.workunit.client.0.smithi047.stdout:test api_watch_notify on pid 74806 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_watch_notify 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74806 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_watch_notify on pid 74806' 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74806 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-04-06T03:36:30.792 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_watch_notify_pp 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_watch_notify_pp' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.793 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.794 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.795 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.796 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.797 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.798 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_watch_notify_pp 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.799 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.800 INFO:tasks.workunit.client.0.smithi047.stdout:test api_watch_notify_pp on pid 74848 2024-04-06T03:36:30.802 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_watch_notify_pp 2024-04-06T03:36:30.802 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74848 2024-04-06T03:36:30.802 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_watch_notify_pp on pid 74848' 2024-04-06T03:36:30.802 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74848 2024-04-06T03:36:30.802 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.803 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.804 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_cmd 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74756/exe 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_cmd' 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74634/exe 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.805 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.806 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.807 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_cmd 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.808 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-04-06T03:36:30.809 INFO:tasks.workunit.client.0.smithi047.stdout:test api_cmd on pid 74867 2024-04-06T03:36:30.810 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_cmd 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74867 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_cmd on pid 74867' 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74867 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.811 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_cmd_pp 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_cmd_pp' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_pool.log 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_pool: /' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.812 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_cmd_pp 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_stat_pp: /' 2024-04-06T03:36:30.813 INFO:tasks.workunit.client.0.smithi047.stdout:test api_cmd_pp on pid 74886 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_cmd_pp 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74886 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_cmd_pp on pid 74886' 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74886 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-04-06T03:36:30.818 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_service 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.819 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_service' 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.820 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_service 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.821 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.822 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.823 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.824 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.825 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.826 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.826 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.826 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.826 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.826 INFO:tasks.workunit.client.0.smithi047.stdout:test api_service on pid 74927 2024-04-06T03:36:30.833 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.833 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.834 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_service 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.835 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74927 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_service on pid 74927' 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=74927 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.836 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74806/exe 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.837 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.838 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.839 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.840 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_watch_notify: /' 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.841 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.842 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.843 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.844 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.845 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.846 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.847 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_service_pp 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_service_pp' 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.848 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.849 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.850 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_service_pp 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74848/exe 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74729/exe 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.851 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.852 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.853 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.854 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.855 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.856 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.856 INFO:tasks.workunit.client.0.smithi047.stdout:test api_service_pp on pid 75014 2024-04-06T03:36:30.857 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_service_pp 2024-04-06T03:36:30.857 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-04-06T03:36:30.857 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75014 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_service_pp on pid 75014' 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75014 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_stat: /' 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_c_write_operations 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-04-06T03:36:30.858 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_c_write_operations' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_c_write_operations 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_stat.log 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.859 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_c_write_operations 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75022 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_c_write_operations on pid 75022' 2024-04-06T03:36:30.860 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75022 2024-04-06T03:36:30.861 INFO:tasks.workunit.client.0.smithi047.stdout:test api_c_write_operations on pid 75022 2024-04-06T03:36:30.864 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.864 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.864 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.864 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.864 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.864 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.864 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.865 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_c_read_operations 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_c_read_operations' 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.866 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74867/exe 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.867 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.868 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.869 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74886/exe 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/74927/exe 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_c_read_operations 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_cmd.log 2024-04-06T03:36:30.870 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_cmd: /' 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.871 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.872 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-04-06T03:36:30.872 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-04-06T03:36:30.872 INFO:tasks.workunit.client.0.smithi047.stdout:test api_c_read_operations on pid 75062 2024-04-06T03:36:30.875 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_c_read_operations 2024-04-06T03:36:30.875 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75062 2024-04-06T03:36:30.875 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_c_read_operations on pid 75062' 2024-04-06T03:36:30.875 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75062 2024-04-06T03:36:30.875 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.875 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s api_cls_remote_reads 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' api_cls_remote_reads' 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.876 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo api_cls_remote_reads 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.877 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.878 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.879 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_service.log 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_service: /' 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.880 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.881 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.882 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.883 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.884 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.885 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.886 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.886 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.886 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.886 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.886 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.886 INFO:tasks.workunit.client.0.smithi047.stdout:test api_cls_remote_reads on pid 75089 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=api_cls_remote_reads 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75089 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test api_cls_remote_reads on pid 75089' 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75089 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.890 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.891 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.892 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.893 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s list_parallel 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' list_parallel' 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.894 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.895 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.896 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.897 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75022/exe 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.898 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.899 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.900 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-04-06T03:36:30.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo list_parallel 2024-04-06T03:36:30.902 INFO:tasks.workunit.client.0.smithi047.stdout:test list_parallel on pid 75150 2024-04-06T03:36:30.907 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=list_parallel 2024-04-06T03:36:30.907 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75150 2024-04-06T03:36:30.907 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test list_parallel on pid 75150' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75150 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.908 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.909 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s open_pools_parallel 2024-04-06T03:36:30.910 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' open_pools_parallel' 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.911 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75062/exe 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.912 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo open_pools_parallel 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.913 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.914 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.915 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.916 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.917 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-04-06T03:36:30.918 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=open_pools_parallel 2024-04-06T03:36:30.918 INFO:tasks.workunit.client.0.smithi047.stdout:test open_pools_parallel on pid 75183 2024-04-06T03:36:30.921 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75183 2024-04-06T03:36:30.921 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test open_pools_parallel on pid 75183' 2024-04-06T03:36:30.921 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75183 2024-04-06T03:36:30.921 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75014/exe 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.922 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s delete_pools_parallel 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' delete_pools_parallel' 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.923 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.924 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.925 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo delete_pools_parallel 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_service_pp: /' 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75089/exe 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.926 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.927 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.927 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.927 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.927 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.927 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.927 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.929 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.930 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.931 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=delete_pools_parallel 2024-04-06T03:36:30.932 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75215 2024-04-06T03:36:30.933 INFO:tasks.workunit.client.0.smithi047.stdout:test delete_pools_parallel on pid 75215 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test delete_pools_parallel on pid 75215' 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75215 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.936 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.937 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75150/exe 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.938 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ list_parallel: /' 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_list_parallel.log 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.939 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.940 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s cls 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' cls' 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.941 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.942 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.943 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo cls 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.944 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.945 INFO:tasks.workunit.client.0.smithi047.stdout:test cls on pid 75280 2024-04-06T03:36:30.946 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=cls 2024-04-06T03:36:30.946 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75280 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test cls on pid 75280' 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75280 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s cmd 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' cmd' 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo cmd 2024-04-06T03:36:30.947 INFO:tasks.workunit.client.0.smithi047.stdout:test cmd on pid 75300 2024-04-06T03:36:30.953 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=cmd 2024-04-06T03:36:30.953 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75300 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test cmd on pid 75300' 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75300 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s handler_error 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.954 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.955 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.956 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' handler_error' 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.957 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.958 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.959 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo handler_error 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.960 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.961 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.962 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.963 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.964 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.964 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.964 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=handler_error 2024-04-06T03:36:30.964 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.964 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75328 2024-04-06T03:36:30.964 INFO:tasks.workunit.client.0.smithi047.stdout:test handler_error on pid 75328 2024-04-06T03:36:30.970 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test handler_error on pid 75328' 2024-04-06T03:36:30.970 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75328 2024-04-06T03:36:30.970 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.971 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.972 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75215/exe 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.973 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.974 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.975 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.976 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.977 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75183/exe 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:30.978 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.979 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:30.980 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.981 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.982 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s io 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' io' 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.983 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.984 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.985 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.986 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75300/exe 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo io 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.987 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_cmd 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.988 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_cmd.log 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.989 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.990 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ cmd: /' 2024-04-06T03:36:30.990 INFO:tasks.workunit.client.0.smithi047.stdout:test io on pid 75435 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=io 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75280/exe 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75435 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test io on pid 75435' 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75435 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:30.993 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.994 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.995 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ cls: /' 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:30.996 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s ec_io 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' ec_io' 2024-04-06T03:36:30.997 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75328/exe 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_cls 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_cls.log 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo ec_io 2024-04-06T03:36:30.998 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_handler_error 2024-04-06T03:36:30.999 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_handler_error.log 2024-04-06T03:36:30.999 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ handler_error: /' 2024-04-06T03:36:30.999 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:30.999 INFO:tasks.workunit.client.0.smithi047.stdout:test ec_io on pid 75469 2024-04-06T03:36:31.001 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=ec_io 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75469 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test ec_io on pid 75469' 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75469 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.002 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.003 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.004 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s list 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' list' 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.005 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.006 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo list 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.007 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.008 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.009 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.010 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.011 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75435/exe 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.012 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=list 2024-04-06T03:36:31.013 INFO:tasks.workunit.client.0.smithi047.stdout:test list on pid 75550 2024-04-06T03:36:31.016 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75550 2024-04-06T03:36:31.016 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test list on pid 75550' 2024-04-06T03:36:31.016 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75550 2024-04-06T03:36:31.016 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:31.016 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.016 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s ec_list 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' ec_list' 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.017 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_io 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo ec_list 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_io.log 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ io: /' 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.018 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.019 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75469/exe 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.020 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.021 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.022 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.022 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.022 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.022 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.022 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.022 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.022 INFO:tasks.workunit.client.0.smithi047.stdout:test ec_list on pid 75581 2024-04-06T03:36:31.025 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.025 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=ec_list 2024-04-06T03:36:31.025 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.025 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.025 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.025 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75581 2024-04-06T03:36:31.025 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test ec_list on pid 75581' 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75581 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ ec_io: /' 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_ec_io.log 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s misc 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.026 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' misc' 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo misc 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.027 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_ec_io 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.028 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.029 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.030 INFO:tasks.workunit.client.0.smithi047.stdout:test misc on pid 75610 2024-04-06T03:36:31.031 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=misc 2024-04-06T03:36:31.031 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75610 2024-04-06T03:36:31.031 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test misc on pid 75610' 2024-04-06T03:36:31.031 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75610 2024-04-06T03:36:31.031 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:31.031 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s pool 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.032 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.033 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' pool' 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo pool 2024-04-06T03:36:31.034 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.035 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.036 INFO:tasks.workunit.client.0.smithi047.stdout:test pool on pid 75632 2024-04-06T03:36:31.040 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=pool 2024-04-06T03:36:31.040 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.040 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.040 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75632 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test pool on pid 75632' 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75632 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.041 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s read_operations 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' read_operations' 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo read_operations 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:31.042 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.043 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.044 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.045 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.046 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=read_operations 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75647 2024-04-06T03:36:31.047 INFO:tasks.workunit.client.0.smithi047.stdout:test read_operations on pid 75647 2024-04-06T03:36:31.050 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test read_operations on pid 75647' 2024-04-06T03:36:31.050 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75647 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s snapshots 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' snapshots' 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo snapshots 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.051 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.052 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.053 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.054 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75550/exe 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=snapshots 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.055 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.056 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.056 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.056 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.056 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.056 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.056 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.056 INFO:tasks.workunit.client.0.smithi047.stdout:test snapshots on pid 75659 2024-04-06T03:36:31.058 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75659 2024-04-06T03:36:31.058 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test snapshots on pid 75659' 2024-04-06T03:36:31.058 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75659 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.059 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.060 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s watch_notify 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.061 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' watch_notify' 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75581/exe 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.062 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo watch_notify 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.063 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.064 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.065 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.066 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.067 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_list 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.068 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.069 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.069 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.069 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ list: /' 2024-04-06T03:36:31.069 INFO:tasks.workunit.client.0.smithi047.stdout:test watch_notify on pid 75688 2024-04-06T03:36:31.072 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=watch_notify 2024-04-06T03:36:31.072 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.072 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.072 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75688 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test watch_notify on pid 75688' 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75688 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_list.log 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.073 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:++ printf %25s write_operations 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+ r=' write_operations' 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_ec_list 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_ec_list.log 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.074 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.075 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.076 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo write_operations 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.077 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ ec_list: /' 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.078 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.079 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.079 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.079 INFO:tasks.workunit.client.0.smithi047.stdout:test write_operations on pid 75719 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+ ff=write_operations 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75719 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'test write_operations on pid 75719' 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+ pids[$f]=75719 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+ ret=0 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 1 -eq 1 ']' 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:36:31.086 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74564 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74564 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.087 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.088 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.089 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.090 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.091 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75610/exe 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -f /etc/bashrc ']' 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:+ . /etc/bashrc 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.092 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -z '' ']' 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ BASHRCSOURCED=Y 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ shopt -q login_shell 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:+++ umask 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' 0022 -eq 0 ']' 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ SHELL=/bin/bash 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.093 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75632/exe 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.094 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.095 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ misc: /' 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_misc 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_misc.log 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'grep=grep --color=auto' 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorls.sh 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' '!' -t 0 ']' 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:+++ return 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.096 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export S_COLORS=auto 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:+++ S_COLORS=auto 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.097 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_pool 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.098 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.099 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_pool.log 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.100 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75647/exe 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ pool: /' 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-06T03:36:31.101 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.102 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.103 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.104 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_read_operations 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/gawk.sh 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ read_operations: /' 2024-04-06T03:36:31.105 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/lang.sh 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/locale 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.106 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.107 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_read_operations.log 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.108 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75659/exe 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.109 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75688/exe 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:++++ export LANG=en_US.UTF-8 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:++++ LANG=en_US.UTF-8 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+++ LANG=en_US.UTF-8 2024-04-06T03:36:31.110 INFO:tasks.workunit.client.0.smithi047.stderr:+++ unset LANG_backup config 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n '' ']' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ snapshots: /' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' dumb = linux ']' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/less.sh 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++ for i in /etc/profile.d/*.sh 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++ '[' '' ']' 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++ . /etc/profile.d/which2.sh 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-06T03:36:31.111 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_snapshots.log 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+++++ readlink /proc/75719/exe 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_snapshots 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:++++ basename /usr/bin/bash 2024-04-06T03:36:31.112 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ watch_notify: /' 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_declare='declare -f' 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+++ which_opt=-f 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export which_declare 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+++ export -f which 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset i 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:++ unset -f pathmunge 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PATH 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ unset rc 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_watch_notify 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ sed 's/^/ write_operations: /' 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ tee ceph_test_neorados_write_operations.log 2024-04-06T03:36:31.113 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph_test_neorados_write_operations 2024-04-06T03:36:31.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:36:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:36:31.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:31 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:31.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:31.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:31.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:31.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:31 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:31.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:31.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:31.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:31 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:32.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:32 smithi102 ceph-mon[32821]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:32.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/571426974' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1854554803' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/188874995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:32 smithi102 ceph-mon[32821]: osdmap e73: 8 total, 8 up, 8 in 2024-04-06T03:36:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[29365]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/571426974' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1854554803' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/188874995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[29365]: osdmap e73: 8 total, 8 up, 8 in 2024-04-06T03:36:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[37680]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/571426974' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1854554803' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/188874995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:32 smithi047 ceph-mon[37680]: osdmap e73: 8 total, 8 up, 8 in 2024-04-06T03:36:33.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:33.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2628996893' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:33.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:33 smithi047 ceph-mon[29365]: osdmap e74: 8 total, 8 up, 8 in 2024-04-06T03:36:33.994 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:36:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:36:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:36:33.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:33.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2628996893' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:33.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:33 smithi047 ceph-mon[37680]: osdmap e74: 8 total, 8 up, 8 in 2024-04-06T03:36:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2628996893' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:33 smithi102 ceph-mon[32821]: osdmap e74: 8 total, 8 up, 8 in 2024-04-06T03:36:36.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[29365]: pgmap v65: 228 pgs: 96 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:36:36.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4066022839' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:36.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[29365]: Health check failed: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:36.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[37680]: pgmap v65: 228 pgs: 96 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:36:36.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4066022839' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:36.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:36.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[37680]: Health check failed: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:36.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:36 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:36.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:36 smithi102 ceph-mon[32821]: pgmap v65: 228 pgs: 96 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:36:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4066022839' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:36 smithi102 ceph-mon[32821]: Health check failed: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:36 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:37.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1635151913' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4105154039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/145822482' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[37680]: pgmap v68: 484 pgs: 352 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[37680]: osdmap e75: 8 total, 8 up, 8 in 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1635151913' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4105154039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/145822482' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[29365]: pgmap v68: 484 pgs: 352 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[29365]: osdmap e75: 8 total, 8 up, 8 in 2024-04-06T03:36:37.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1635151913' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4105154039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/145822482' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:37 smithi102 ceph-mon[32821]: pgmap v68: 484 pgs: 352 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:36:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:37 smithi102 ceph-mon[32821]: osdmap e75: 8 total, 8 up, 8 in 2024-04-06T03:36:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:39.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3356206245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2008519182' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/539421048' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: pgmap v70: 804 pgs: 450 creating+peering, 221 active+clean, 133 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: osdmap e76: 8 total, 8 up, 8 in 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3582560806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi047-74795-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2345860159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi047-74786-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4129826599' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3087252643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi047-74864-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3356206245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2008519182' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/539421048' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: pgmap v70: 804 pgs: 450 creating+peering, 221 active+clean, 133 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: osdmap e76: 8 total, 8 up, 8 in 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3582560806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi047-74795-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2345860159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi047-74786-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4129826599' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:39.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3087252643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi047-74864-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3356206245' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2008519182' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/539421048' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: pgmap v70: 804 pgs: 450 creating+peering, 221 active+clean, 133 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: osdmap e76: 8 total, 8 up, 8 in 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3582560806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi047-74795-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2345860159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi047-74786-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4129826599' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3087252643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi047-74864-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.190 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [----------] Global test environment set-up. 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [----------] 12 tests from AsioRados 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1 ms) 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2024-04-06T03:36:40.191 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (9 ms) 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (7 ms) 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (3 ms) 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2024-04-06T03:36:40.192 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (2 ms) 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (5 ms) 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (2 ms) 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [----------] 12 tests from AsioRados (32 ms total) 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [----------] Global test environment tear-down 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (9506 ms total) 2024-04-06T03:36:40.193 INFO:tasks.workunit.client.0.smithi047.stdout: api_asio: [ PASSED ] 12 tests. 2024-04-06T03:36:40.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:40.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/399263266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: osdmap e77: 8 total, 8 up, 8 in 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1642337165' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3963705945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/399263266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: osdmap e77: 8 total, 8 up, 8 in 2024-04-06T03:36:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1642337165' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3963705945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi047-75582-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:40.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/399263266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:40.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: osdmap e77: 8 total, 8 up, 8 in 2024-04-06T03:36:40.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:40.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1642337165' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-04-06T03:36:40.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3963705945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:40.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:40.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.498 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-04-06T03:36:41.498 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [----------] Global test environment set-up. 2024-04-06T03:36:41.498 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [----------] 4 tests from LibRadosService 2024-04-06T03:36:41.498 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-04-06T03:36:41.498 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5055 ms) 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ OK ] LibRadosService.RegisterLate (34 ms) 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: cluster: 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: id: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: health: HEALTH_WARN 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 11 pool(s) do not have an application enabled 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: services: 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-04-06T03:36:41.499 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: data: 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: pools: 17 pools, 484 pgs 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: objects: 230 objects, 582 KiB 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: pgs: 72.727% pgs unknown 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 352 unknown 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 132 active+clean 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: io: 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: cluster: 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: id: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:36:41.500 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: health: HEALTH_WARN 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 21 pool(s) do not have an application enabled 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: services: 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: foo: 12 portals active (1 hosts, 3 zones) 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: data: 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: pools: 27 pools, 804 pgs 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: objects: 230 objects, 582 KiB 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: pgs: 16.542% pgs unknown 2024-04-06T03:36:41.501 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 55.970% pgs not active 2024-04-06T03:36:41.502 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 450 creating+peering 2024-04-06T03:36:41.502 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 221 active+clean 2024-04-06T03:36:41.502 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 133 unknown 2024-04-06T03:36:41.502 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.502 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: io: 2024-04-06T03:36:41.502 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: client: 1.0 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-04-06T03:36:41.502 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: cluster: 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: id: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: health: HEALTH_WARN 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 26 pool(s) do not have an application enabled 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: services: 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-04-06T03:36:41.503 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-04-06T03:36:41.694 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-04-06T03:36:41.694 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [----------] Global test environment set-up. 2024-04-06T03:36:41.694 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [----------] 7 tests from LibRadosList 2024-04-06T03:36:41.694 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-04-06T03:36:41.694 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosList.ListObjects (1382 ms) 2024-04-06T03:36:41.694 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-04-06T03:36:41.694 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (31 ms) 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: myset foo1,foo2,foo3 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo1 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo2 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo3 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: myset foo1,foo4,foo5 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo4 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo5 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo1 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: myset foo6,foo7 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo7 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo6 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns1:foo4 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns1:foo5 2024-04-06T03:36:41.695 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns2:foo7 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns2:foo6 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns1:foo1 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: :foo1 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: :foo2 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: :foo3 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (83 ms) 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 1 0 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 10 0 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 13 0 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 7 0 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 14 0 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 0 0 2024-04-06T03:36:41.696 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 15 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 11 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 5 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 8 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 6 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 3 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 4 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 12 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 9 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 2 0 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (61 ms) 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: x cursor=MIN 2024-04-06T03:36:41.697 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=1 cursor=16:02547ec2:::1:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=10 cursor=16:52ea6a34:::10:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=13 cursor=16:566253c9:::13:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=7 cursor=16:5c6b0b28:::7:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=14 cursor=16:62a1935d:::14:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=0 cursor=16:6cac518f:::0:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=15 cursor=16:863748b0:::15:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=11 cursor=16:89d3ae78:::11:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=5 cursor=16:b29083e3:::5:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=8 cursor=16:bd63b0f1:::8:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=6 cursor=16:c4fdafeb:::6:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=3 cursor=16:cfc208b3:::3:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=4 cursor=16:d83876eb:::4:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=12 cursor=16:de5d7c5f:::12:head 2024-04-06T03:36:41.698 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=9 cursor=16:e960b815:::9:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > oid=2 cursor=16:f905c69b:::2:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: FIRST> seek to MIN oid=1 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=1 cursor=16:02547ec2:::1:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:02547ec2:::1:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:02547ec2:::1:head -> 1 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=10 cursor=16:52ea6a34:::10:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:52ea6a34:::10:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:52ea6a34:::10:head -> 10 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=13 cursor=16:566253c9:::13:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:566253c9:::13:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:566253c9:::13:head -> 13 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=7 cursor=16:5c6b0b28:::7:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:5c6b0b28:::7:head 2024-04-06T03:36:41.699 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:5c6b0b28:::7:head -> 7 2024-04-06T03:36:41.755 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=14 cursor=16:62a1935d:::14:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:62a1935d:::14:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:62a1935d:::14:head -> 14 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=0 cursor=16:6cac518f:::0:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:6cac518f:::0:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:6cac518f:::0:head -> 0 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=15 cursor=16:863748b0:::15:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:863748b0:::15:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:863748b0:::15:head -> 15 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=11 cursor=16:89d3ae78:::11:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:89d3ae78:::11:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:89d3ae78:::11:head -> 11 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=5 cursor=16:b29083e3:::5:head 2024-04-06T03:36:41.756 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:b29083e3:::5:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:b29083e3:::5:head -> 5 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=8 cursor=16:bd63b0f1:::8:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:bd63b0f1:::8:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:bd63b0f1:::8:head -> 8 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=6 cursor=16:c4fdafeb:::6:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:c4fdafeb:::6:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:c4fdafeb:::6:head -> 6 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=3 cursor=16:cfc208b3:::3:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:cfc208b3:::3:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:cfc208b3:::3:head -> 3 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=4 cursor=16:d83876eb:::4:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:d83876eb:::4:head 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:d83876eb:::4:head -> 4 2024-04-06T03:36:41.757 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=12 cursor=16:de5d7c5f:::12:head 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:de5d7c5f:::12:head 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:de5d7c5f:::12:head -> 12 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=9 cursor=16:e960b815:::9:head 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:e960b815:::9:head 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:e960b815:::9:head -> 9 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : oid=2 cursor=16:f905c69b:::2:head 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:f905c69b:::2:head 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:f905c69b:::2:head -> 2 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:62a1935d:::14:head 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:62a1935d:::14:head expected=16:62a1935d:::14:head 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:62a1935d:::14:head -> 14 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=14 expected=14 2024-04-06T03:36:41.758 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:cfc208b3:::3:head 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:cfc208b3:::3:head expected=16:cfc208b3:::3:head 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:cfc208b3:::3:head -> 3 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=3 expected=3 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:f905c69b:::2:head 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:f905c69b:::2:head expected=16:f905c69b:::2:head 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:f905c69b:::2:head -> 2 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=2 expected=2 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:e960b815:::9:head 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:e960b815:::9:head expected=16:e960b815:::9:head 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:e960b815:::9:head -> 9 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=9 expected=9 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:de5d7c5f:::12:head 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:de5d7c5f:::12:head expected=16:de5d7c5f:::12:head 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:de5d7c5f:::12:head -> 12 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=12 expected=12 2024-04-06T03:36:41.759 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:d83876eb:::4:head 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:d83876eb:::4:head expected=16:d83876eb:::4:head 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:d83876eb:::4:head -> 4 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=4 expected=4 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:6cac518f:::0:head 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:6cac518f:::0:head expected=16:6cac518f:::0:head 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:6cac518f:::0:head -> 0 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=0 expected=0 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:52ea6a34:::10:head 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:52ea6a34:::10:head expected=16:52ea6a34:::10:head 2024-04-06T03:36:41.760 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:52ea6a34:::10:head -> 10 2024-04-06T03:36:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: pgmap v72: 964 pgs: 450 creating+peering, 221 active+clean, 293 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2024-04-06T03:36:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3582560806' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi047-74795-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2345860159' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi047-74786-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3087252643' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi047-74864-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/866981994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/358604914' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: osdmap e78: 8 total, 8 up, 8 in 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: pgmap v72: 964 pgs: 450 creating+peering, 221 active+clean, 293 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3582560806' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi047-74795-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2345860159' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi047-74786-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3087252643' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi047-74864-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/866981994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/358604914' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:41.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: osdmap e78: 8 total, 8 up, 8 in 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3963705945' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: osdmap e79: 8 total, 8 up, 8 in 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.998 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3963705945' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:41.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:41.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: osdmap e79: 8 total, 8 up, 8 in 2024-04-06T03:36:41.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:42.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:36:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: pgmap v72: 964 pgs: 450 creating+peering, 221 active+clean, 293 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2024-04-06T03:36:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi047-74496-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi047-74473-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3582560806' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi047-74795-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2345860159' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi047-74786-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi047-75691-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3087252643' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi047-74864-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi047-74545-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi047-74936-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/866981994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/358604914' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: osdmap e78: 8 total, 8 up, 8 in 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi047-74512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi047-75177-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75209-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3963705945' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi047-74586-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi047-74601-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi047-74590-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: osdmap e79: 8 total, 8 up, 8 in 2024-04-06T03:36:42.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:42.608 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : en handler_error: Running main() from gmock_main.cc 2024-04-06T03:36:42.608 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-04-06T03:36:42.608 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [----------] Global test environment set-up. 2024-04-06T03:36:42.608 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-04-06T03:36:42.608 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-04-06T03:36:42.608 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (11647 ms) 2024-04-06T03:36:42.608 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [----------] 1 test from neocls_handler_error (11647 ms total) 2024-04-06T03:36:42.609 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: 2024-04-06T03:36:42.609 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [----------] Global test environment tear-down 2024-04-06T03:36:42.609 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [==========] 1 test from 1 test suite ran. (11647 ms total) 2024-04-06T03:36:42.609 INFO:tasks.workunit.client.0.smithi047.stdout: handler_error: [ PASSED ] 1 test. 2024-04-06T03:36:42.612 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-04-06T03:36:42.612 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-04-06T03:36:42.612 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-04-06T03:36:42.612 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-04-06T03:36:42.612 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (11717 ms) 2024-04-06T03:36:42.612 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (11717 ms total) 2024-04-06T03:36:42.612 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (11717 ms total) 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (101 ms) 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (1128 ms) 2024-04-06T03:36:42.613 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (89 ms) 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (48 ms) 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (7 ms) 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (8 ms) 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (6 ms) 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (6 ms) 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (3 ms) 2024-04-06T03:36:42.614 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (6 ms) 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (4 ms) 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (4 ms) 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (18 ms) 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (14 ms) 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (7 ms) 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (5 ms) 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (1454 ms total) 2024-04-06T03:36:42.615 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: 2024-04-06T03:36:42.616 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-04-06T03:36:42.616 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (11742 ms total) 2024-04-06T03:36:42.616 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (40 ms) 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (45 ms) 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (12767 ms) 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (12852 ms total) 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: 2024-04-06T03:36:43.683 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-04-06T03:36:43.684 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (12852 ms total) 2024-04-06T03:36:43.684 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-04-06T03:36:43.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:36:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:36:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: pgmap v75: 1284 pgs: 450 creating+peering, 221 active+clean, 613 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: osdmap e80: 8 total, 8 up, 8 in 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4054494995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/251827274' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: pgmap v75: 1284 pgs: 450 creating+peering, 221 active+clean, 613 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:43.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: osdmap e80: 8 total, 8 up, 8 in 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4054494995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/251827274' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:43.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:43.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:43.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:43.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:43.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:43.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: pgmap v75: 1284 pgs: 450 creating+peering, 221 active+clean, 613 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi047-75582-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi047-74999-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi047-74676-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75058-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: osdmap e80: 8 total, 8 up, 8 in 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4054494995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/251827274' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi047-75691-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: pgmap v78: 748 pgs: 63 creating+peering, 552 active+clean, 133 unknown; 584 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 353 op/s 2024-04-06T03:36:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:36:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: pgmap v78: 748 pgs: 63 creating+peering, 552 active+clean, 133 unknown; 584 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 353 op/s 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:36:44.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:36:44.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: osdmap e81: 8 total, 8 up, 8 in 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1759352757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2208257725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:44.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: osdmap e82: 8 total, 8 up, 8 in 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: Health check update: 21 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: osdmap e81: 8 total, 8 up, 8 in 2024-04-06T03:36:44.999 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1759352757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2208257725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: osdmap e82: 8 total, 8 up, 8 in 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: Health check update: 21 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:45.000 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi047-74512-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75040-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: pgmap v78: 748 pgs: 63 creating+peering, 552 active+clean, 133 unknown; 584 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 353 op/s 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:36:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:36:45.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: osdmap e81: 8 total, 8 up, 8 in 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi047-74996-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1759352757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2208257725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: osdmap e82: 8 total, 8 up, 8 in 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: Health check update: 21 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:45.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:45.088 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:45.088 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: 13.8 deep-scrub starts 2024-04-06T03:36:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: 13.8 deep-scrub ok 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: 13.3 deep-scrub starts 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: 13.3 deep-scrub ok 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: pgmap v80: 820 pgs: 63 creating+peering, 488 active+clean, 269 unknown; 584 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 6.0 KiB/s wr, 328 op/s 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: osdmap e83: 8 total, 8 up, 8 in 2024-04-06T03:36:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: 13.8 deep-scrub starts 2024-04-06T03:36:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: 13.8 deep-scrub ok 2024-04-06T03:36:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: 13.3 deep-scrub starts 2024-04-06T03:36:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: 13.3 deep-scrub ok 2024-04-06T03:36:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: pgmap v80: 820 pgs: 63 creating+peering, 488 active+clean, 269 unknown; 584 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 6.0 KiB/s wr, 328 op/s 2024-04-06T03:36:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: osdmap e83: 8 total, 8 up, 8 in 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: 13.8 deep-scrub starts 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: 13.8 deep-scrub ok 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: 13.3 deep-scrub starts 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: 13.3 deep-scrub ok 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: pgmap v80: 820 pgs: 63 creating+peering, 488 active+clean, 269 unknown; 584 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 6.0 KiB/s wr, 328 op/s 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:46.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:46.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/850172159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:46.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:46.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: osdmap e83: 8 total, 8 up, 8 in 2024-04-06T03:36:46.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]: dispatch 2024-04-06T03:36:47.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: 13.4 deep-scrub starts 2024-04-06T03:36:47.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: 13.4 deep-scrub ok 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: osdmap e84: 8 total, 8 up, 8 in 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi047-75582-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:47.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: 13.4 deep-scrub starts 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: 13.4 deep-scrub ok 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: osdmap e84: 8 total, 8 up, 8 in 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi047-75582-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: 13.4 deep-scrub starts 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: 13.4 deep-scrub ok 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:36:47.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: osdmap e84: 8 total, 8 up, 8 in 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi047-75582-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:47.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.934 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: Running main() from gmock_main.cc 2024-04-06T03:36:47.935 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-04-06T03:36:47.935 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [----------] Global test environment set-up. 2024-04-06T03:36:47.935 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-04-06T03:36:47.935 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-04-06T03:36:47.935 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (8155 ms) 2024-04-06T03:36:47.935 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (51 ms) 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (7829 ms) 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:45.765492+0000 mon.a [INF] from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:45.768222+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi047-74512-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:45.768321+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi047-75582-1"}]': finished 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:45.778648+0000 mon.c [INF] from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:45.783598+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.054604+0000 mon.a [INF] from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.054854+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:47.936 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.055902+0000 mon.b [INF] from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.310244+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.311390+0000 mon.b [INF] from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.312406+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.312689+0000 mon.a [INF] from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi047-75582-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.567847+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.827884+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.828987+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.829083+0000 mon.a [INF] from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.829143+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.829221+0000 mon.a [INF] from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi047-75582-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.829288+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.839135+0000 mon.b [INF] from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.840234+0000 mon.b [INF] from='client.? 172.21.15.47:0/3102191862' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:47.937 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.842414+0000 mon.c [INF] from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-06T03:36:47.938 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.847327+0000 mon.a [INF] from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi047-75582-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:47.938 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.914103+0000 mon.c [INF] from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-06T03:36:47.938 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:46.914555+0000 client.admin [INF] onexx 2024-04-06T03:36:47.938 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.157878+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-06T03:36:47.938 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.158234+0000 mon.a [INF] from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:47.938 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.163415+0000 mon.b [INF] from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:47.938 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.164961+0000 mon.c [INF] from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.2 deep-scrub starts 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.2 deep-scrub ok 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.7 deep-scrub starts 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.7 deep-scrub ok 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.6 deep-scrub starts 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.6 deep-scrub ok 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.9 deep-scrub starts 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.9 deep-scrub ok 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.1 deep-scrub starts 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.1 deep-scrub ok 2024-04-06T03:36:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.0 deep-scrub starts 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.0 deep-scrub ok 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.5 deep-scrub starts 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: 13.5 deep-scrub ok 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: pgmap v83: 988 pgs: 214 creating+peering, 614 active+clean, 160 unknown; 145 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 30 op/s 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi047-75582-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: osdmap e85: 8 total, 8 up, 8 in 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3102191862' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi047-75582-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: onexx 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.2 deep-scrub starts 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.2 deep-scrub ok 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.7 deep-scrub starts 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.7 deep-scrub ok 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.6 deep-scrub starts 2024-04-06T03:36:48.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.6 deep-scrub ok 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.9 deep-scrub starts 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.9 deep-scrub ok 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.1 deep-scrub starts 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.1 deep-scrub ok 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.0 deep-scrub starts 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.0 deep-scrub ok 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.5 deep-scrub starts 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: 13.5 deep-scrub ok 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: pgmap v83: 988 pgs: 214 creating+peering, 614 active+clean, 160 unknown; 145 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 30 op/s 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi047-75582-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:48.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: osdmap e85: 8 total, 8 up, 8 in 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3102191862' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi047-75582-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: onexx 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-06T03:36:48.248 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.2 deep-scrub starts 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.2 deep-scrub ok 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.7 deep-scrub starts 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.7 deep-scrub ok 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.6 deep-scrub starts 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.6 deep-scrub ok 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.9 deep-scrub starts 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.9 deep-scrub ok 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.1 deep-scrub starts 2024-04-06T03:36:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.1 deep-scrub ok 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.0 deep-scrub starts 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.0 deep-scrub ok 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.5 deep-scrub starts 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: 13.5 deep-scrub ok 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: pgmap v83: 988 pgs: 214 creating+peering, 614 active+clean, 160 unknown; 145 MiB data, 586 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 30 op/s 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi047-74496-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi047-74473-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi047-75582-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: osdmap e85: 8 total, 8 up, 8 in 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3102191862' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4270432395' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi047-75582-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: onexx 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:48.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:48.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: twoxx 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]': finished 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: osdmap e86: 8 total, 8 up, 8 in 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-4", "overlaypool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:49.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:49.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:49.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:49.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:49.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:49.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-06T03:36:49.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-06T03:36:49.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: twoxx 2024-04-06T03:36:49.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:49.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-06T03:36:49.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]': finished 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: osdmap e86: 8 total, 8 up, 8 in 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-4", "overlaypool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:49.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:49.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:49.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:49.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:49.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: twoxx 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi047-74496-3", "field": "max_bytes", "val": "4096"}]': finished 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:49.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: osdmap e86: 8 total, 8 up, 8 in 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-4", "overlaypool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:49.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:49.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:49.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:49.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:49.605 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.409987+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log delete_pools_parallel: process_1_[75430]: starting. 2024-04-06T03:36:49.605 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_1_[75430]: creating pool ceph_test_rados_delete_pools_parallel.smithi047-75350 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_1_[75430]: created object 0... 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_1_[75430]: created object 25... 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_1_[75430]: created object 49... 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_1_[75430]: finishing. 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_1_[75430]: shutting down. 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_2_[75432]: starting. 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_2_[75432]: deleting pool ceph_test_rados_delete_pools_parallel.smithi047-75350 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_2_[75432]: shutting down. 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: ******************************* 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_3_[76588]: starting. 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_3_[76588]: creating pool ceph_test_rados_delete_pools_parallel.smithi047-75350 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_3_[76588]: created object 0... 2024-04-06T03:36:49.606 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_3_[76588]: created object 25... 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_3_[76588]: created object 49... 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_3_[76588]: finishing. 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_3_[76588]: shutting down. 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: ******************************* 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_5_[76590]: starting. 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_5_[76590]: listing objects. 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_5_[76590]: listed object 0... 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_5_[76590]: listed object 25... 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_5_[76590]: saw 50 objects 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_5_[76590]: shutting down. 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: ******************************* 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_4_[76589]: starting. 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_4_[76589]: deleting pool ceph_test_rados_delete_pools_parallel.smithi047-75350 2024-04-06T03:36:49.607 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: process_4_[76589]: shutting down. 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: ******************************* 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: ******************************* 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: cls: Running main() from gmock_main.cc 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [----------] Global test environment set-up. 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [ OK ] NeoRadosCls.DNE (11653 ms) 2024-04-06T03:36:49.608 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (6986 ms) 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [----------] 2 tests from NeoRadosCls (18639 ms total) 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: cls: 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [----------] Global test environment tear-down 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [==========] 2 tests from 1 test suite ran. (18639 ms total) 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: cls: [ PASSED ] 2 tests. 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_1_[75467]: starting. 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_1_[75467]: creating pool ceph_test_rados_open_pools_parallel.smithi047-75383 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_1_[75467]: created object 0... 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_1_[75467]: created object 25... 2024-04-06T03:36:49.609 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_1_[75467]: created object 49... 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_1_[75467]: finishing. 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_1_[75467]: shutting down. 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_2_[75468]: starting. 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_2_[75468]: rados_pool_create. 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_2_[75468]: rados_ioctx_create. 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_2_[75468]: shutting down. 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: ******************************* 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_3_[76752]: starting. 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_3_[76752]: creating pool ceph_test_rados_open_pools_parallel.smithi047-75383 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_3_[76752]: created object 0... 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_3_[76752]: created object 25... 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_3_[76752]: created object 49... 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_3_[76752]: finishing. 2024-04-06T03:36:49.610 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_3_[76752]: shutting down. 2024-04-06T03:36:49.611 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: ******************************* 2024-04-06T03:36:49.611 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_4_[76753]: starting. 2024-04-06T03:36:49.611 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_4_[76753]: rados_pool_create. 2024-04-06T03:36:49.611 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_4_[76753]: rados_ioctx_create. 2024-04-06T03:36:49.611 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: process_4_[76753]: shutting down. 2024-04-06T03:36:49.611 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: ******************************* 2024-04-06T03:36:49.611 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: ******************************* 2024-04-06T03:36:49.611 INFO:tasks.workunit.client.0.smithi047.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-04-06T03:36:50.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: pgmap v86: 908 pgs: 191 creating+peering, 461 active+clean, 256 unknown; 145 MiB data, 711 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 195 op/s 2024-04-06T03:36:50.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-06T03:36:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi047-75582-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-4", "overlaypool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:50.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:50.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:50.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:50.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:50.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:50.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:50.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:50.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-04-06T03:36:50.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: pgmap v86: 908 pgs: 191 creating+peering, 461 active+clean, 256 unknown; 145 MiB data, 711 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 195 op/s 2024-04-06T03:36:50.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:50.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-06T03:36:50.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi047-75582-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:50.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-4", "overlaypool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:50.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:50.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:50.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:50.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:50.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:50.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:50.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:50.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:50.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-04-06T03:36:50.502 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.502 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3914964361' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.502 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:50.502 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:50.502 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: osdmap e87: 8 total, 8 up, 8 in 2024-04-06T03:36:50.502 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:50.503 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:50.503 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-4-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:36:50.503 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:50.503 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:50.503 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:50.503 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:50.504 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.504 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.504 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:50.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3914964361' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:50.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:50.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: osdmap e87: 8 total, 8 up, 8 in 2024-04-06T03:36:50.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:50.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:50.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-4-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:36:50.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:50.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:50.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:50.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:50.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: pgmap v86: 908 pgs: 191 creating+peering, 461 active+clean, 256 unknown; 145 MiB data, 711 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 195 op/s 2024-04-06T03:36:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-06T03:36:50.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi047-75582-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-4", "overlaypool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3914964361' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: osdmap e87: 8 total, 8 up, 8 in 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-4-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:50.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:50.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:51.047 INFO:tasks.workunit.client.0.smithi047.stdout:", "logtext":["onexx"]}]: dispatch 2024-04-06T03:36:51.047 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.414033+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:51.047 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.414594+0000 mon.c [INF] from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:51.048 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.415140+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:51.048 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.415592+0000 mon.c [INF] from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:51.048 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.416089+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi047-74586-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:51.048 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.419210+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:51.048 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.419507+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:51.048 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.419799+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:51.048 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.420050+0000 mon.b [INF] from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:51.049 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.420105+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:51.049 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.420679+0000 mon.b [INF] from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:51.049 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.424330+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:51.049 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:47.425067+0000 mon.b [INF] from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:51.049 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.042322+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-06T03:36:51.049 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.047561+0000 mon.a [INF] from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi047-75582-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:51.049 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.047654+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi047-74999-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:51.050 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.047744+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:51.050 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.047814+0000 mon.a [INF] from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-4", "overlaypool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:51.050 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.047886+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:51.050 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.047954+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:51.051 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.048006+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:51.051 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.048068+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:51.051 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.054005+0000 mon.b [INF] from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:51.051 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.054320+0000 mon.b [INF] from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:51.052 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.054590+0000 mon.b [INF] from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:51.052 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.054842+0000 mon.b [INF] from='client.? 172.21.15.47:0/382951887' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:51.052 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.055079+0000 mon.b [INF] from='client.? 172.21.15.47:0/2566771163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:51.052 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.194600+0000 mon.c [INF] from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:51.052 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.598821+0000 mon.c [INF] from='client.? 172.21.15.47:0/3914964361' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:51.053 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.608328+0000 mon.c [INF] from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:51.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:51 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:36:51.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:51 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:36:51.788 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:51 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:36:52.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:36:51 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:36:52.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.849765+0000 mon.a [WRN] Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:52.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.855856+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:52.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.856566+0000 mon.a [INF] from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-4-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.856870+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.857498+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.858037+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]: dispatch 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.858914+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]: dispatch 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.865619+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.866104+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:49.866524+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.118271+0000 mon.a [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.124508+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.124615+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.124690+0000 mon.a [INF] from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-4-cache", "mode": "writeback"}]': finished 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.124739+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:52.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.124791+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.124891+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.124992+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.125104+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.130246+0000 mon.c [INF] from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.131675+0000 mon.c [INF] from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2"}]: dispatch 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.134670+0000 mon.c [INF] from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:50.136435+0000 mon.b [INF] from='client.? 172.21.15.47:0/558708354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.045807+0000 mon.c [INF] from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.045934+0000 client.admin [INF] threexx 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.416873+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.418628+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.418733+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.418812+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:36:52.461 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.424465+0000 mon.c [INF] from='client.? 172.21.15.47:0/3549265945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.462 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.425325+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.462 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.437154+0000 mon.b [INF] from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.692293+0000 mon.a [INF] from='client.? ' entity='client. api_io: Running main() from gmock_main.cc 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [----------] Global test environment set-up. 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (100 ms) 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-04-06T03:36:52.473 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: no timeout :/ 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: no timeout :/ 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: no timeout :/ 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: no timeout :/ 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: no timeout :/ 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (496 ms) 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (6 ms) 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.Checksum (2 ms) 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (3 ms) 2024-04-06T03:36:52.474 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (3 ms) 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (2 ms) 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (1 ms) 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.TruncTest (3 ms) 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (3 ms) 2024-04-06T03:36:52.475 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (2 ms) 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.RmXattr (7 ms) 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIo.XattrIter (3 ms) 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [----------] 14 tests from LibRadosIo (631 ms total) 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (2309 ms) 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-04-06T03:36:52.476 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (6 ms) 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (11 ms) 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (5 ms) 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (8 ms) 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (5 ms) 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (3 ms) 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (6 ms) 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-04-06T03:36:52.477 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (11 ms) 2024-04-06T03:36:52.478 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-04-06T03:36:52.478 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (5 ms) 2024-04-06T03:36:52.478 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [----------] 10 tests from LibRadosIoEC (2369 ms total) 2024-04-06T03:36:52.478 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: 2024-04-06T03:36:52.478 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [----------] Global test environment tear-down 2024-04-06T03:36:52.479 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [==========] 24 tests from 2 test suites ran. (21845 ms total) 2024-04-06T03:36:52.479 INFO:tasks.workunit.client.0.smithi047.stdout: api_io: [ PASSED ] 24 tests. 2024-04-06T03:36:52.481 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: Running main() from gmock_main.cc 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [----------] Global test environment set-up. 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (10124 ms) 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (5770 ms) 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (5635 ms) 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [----------] 3 tests from NeoRadosCmd (21529 ms total) 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [----------] Global test environment tear-down 2024-04-06T03:36:52.482 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [==========] 3 tests from 1 test suite ran. (21529 ms total) 2024-04-06T03:36:52.483 INFO:tasks.workunit.client.0.smithi047.stdout: cmd: [ PASSED ] 3 tests. 2024-04-06T03:36:52.487 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: Running main() from gmock_main.cc 2024-04-06T03:36:52.487 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-04-06T03:36:52.487 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [----------] Global test environment set-up. 2024-04-06T03:36:52.488 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-04-06T03:36:52.488 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-04-06T03:36:52.488 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: handle_notify cookie 93844539634880 notify_id 343597383680 notifier_gid 24821 2024-04-06T03:36:52.488 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (11542 ms) 2024-04-06T03:36:52.488 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-04-06T03:36:52.488 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: Trying... 2024-04-06T03:36:52.489 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: handle_notify cookie 93844552330896 notify_id 369367187457 notifier_gid 25001 2024-04-06T03:36:52.489 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: Waiting for 3.000000000s 2024-04-06T03:36:52.489 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: Timed out. 2024-04-06T03:36:52.489 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: Flushing... 2024-04-06T03:36:52.489 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: Flushed... 2024-04-06T03:36:52.490 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (9874 ms) 2024-04-06T03:36:52.490 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (21416 ms total) 2024-04-06T03:36:52.490 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: 2024-04-06T03:36:52.490 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [----------] Global test environment tear-down 2024-04-06T03:36:52.490 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (21416 ms total) 2024-04-06T03:36:52.490 INFO:tasks.workunit.client.0.smithi047.stdout: watch_notify: [ PASSED ] 2 tests. 2024-04-06T03:36:52.622 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: Running main() from gmock_main.cc 2024-04-06T03:36:52.623 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-04-06T03:36:52.623 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [----------] Global test environment set-up. 2024-04-06T03:36:52.623 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-04-06T03:36:52.623 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: seed 74545 2024-04-06T03:36:52.623 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-04-06T03:36:52.623 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-04-06T03:36:52.623 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-04-06T03:36:52.623 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (40 ms) 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (1114 ms) 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (13 ms) 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (10 ms) 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (7 ms) 2024-04-06T03:36:52.624 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (4 ms) 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (1 ms) 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (5 ms) 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (3 ms) 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-04-06T03:36:52.625 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (2 ms) 2024-04-06T03:36:52.626 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-04-06T03:36:52.626 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (6 ms) 2024-04-06T03:36:52.626 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-04-06T03:36:52.626 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (3 ms) 2024-04-06T03:36:52.626 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-04-06T03:36:52.626 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (2 ms) 2024-04-06T03:36:52.626 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-04-06T03:36:52.626 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (3 ms) 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (9 ms) 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (5 ms) 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (4 ms) 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (4 ms) 2024-04-06T03:36:52.627 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (5 ms) 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (1240 ms total) 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (2442 ms) 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (24 ms) 2024-04-06T03:36:52.628 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-04-06T03:36:52.629 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (5 ms) 2024-04-06T03:36:52.629 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-04-06T03:36:52.629 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (3 ms) 2024-04-06T03:36:52.629 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-04-06T03:36:52.629 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (4 ms) 2024-04-06T03:36:52.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:52.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:36:52.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-4-cache", "mode": "writeback"}]': finished 2024-04-06T03:36:52.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:52.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:52.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:52.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:52.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:52.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2"}]: dispatch 2024-04-06T03:36:52.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/558708354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: pgmap v89: 796 pgs: 94 creating+peering, 454 active+clean, 248 unknown; 145 MiB data, 711 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 3.5 KiB/s wr, 163 op/s 2024-04-06T03:36:52.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:52.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-06T03:36:52.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: threexx 2024-04-06T03:36:52.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: osdmap e88: 8 total, 8 up, 8 in 2024-04-06T03:36:52.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:36:52.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:36:52.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:36:52.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: osdmap e89: 8 total, 8 up, 8 in 2024-04-06T03:36:52.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3549265945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:52.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-06T03:36:52.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-4"}]: dispatch 2024-04-06T03:36:52.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:52.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:52.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.750 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:52.750 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:36:52.751 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-4-cache", "mode": "writeback"}]': finished 2024-04-06T03:36:52.751 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:52.751 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:52.751 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:52.751 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:52.751 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:52.751 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.752 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2"}]: dispatch 2024-04-06T03:36:52.752 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.752 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/558708354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.752 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: pgmap v89: 796 pgs: 94 creating+peering, 454 active+clean, 248 unknown; 145 MiB data, 711 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 3.5 KiB/s wr, 163 op/s 2024-04-06T03:36:52.752 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:52.752 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-06T03:36:52.752 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: threexx 2024-04-06T03:36:52.752 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: osdmap e88: 8 total, 8 up, 8 in 2024-04-06T03:36:52.753 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.753 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:36:52.753 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:36:52.753 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:36:52.753 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: osdmap e89: 8 total, 8 up, 8 in 2024-04-06T03:36:52.753 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3549265945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.753 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.753 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:52.754 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-06T03:36:52.754 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-4"}]: dispatch 2024-04-06T03:36:52.754 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.754 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:52.754 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:52.754 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi047-74545-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi047-74586-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-4-cache", "mode": "writeback"}]': finished 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi047-74996-1"}]': finished 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi047-75691-1"}]': finished 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi047-74473-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1618292763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2"}]: dispatch 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/558708354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: pgmap v89: 796 pgs: 94 creating+peering, 454 active+clean, 248 unknown; 145 MiB data, 711 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 3.5 KiB/s wr, 163 op/s 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: threexx 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: osdmap e88: 8 total, 8 up, 8 in 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]: dispatch 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi047-74999-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi047-74864-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi047-74601-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: osdmap e89: 8 total, 8 up, 8 in 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3549265945' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:52.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-06T03:36:52.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-4"}]: dispatch 2024-04-06T03:36:52.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:52.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:36:52.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:52.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:53.532 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN list: Running main() from gmock_main.cc 2024-04-06T03:36:53.532 INFO:tasks.workunit.client.0.smithi047.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-04-06T03:36:53.532 INFO:tasks.workunit.client.0.smithi047.stdout: list: [----------] Global test environment set-up. 2024-04-06T03:36:53.532 INFO:tasks.workunit.client.0.smithi047.stdout: list: [----------] 3 tests from NeoradosList 2024-04-06T03:36:53.532 INFO:tasks.workunit.client.0.smithi047.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-04-06T03:36:53.532 INFO:tasks.workunit.client.0.smithi047.stdout: list: [ OK ] NeoradosList.ListObjects (12614 ms) 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: [ OK ] NeoradosList.ListObjectsNS (5957 ms) 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: [ OK ] NeoradosList.ListObjectsMany (3921 ms) 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: [----------] 3 tests from NeoradosList (22492 ms total) 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: [----------] Global test environment tear-down 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: [==========] 3 tests from 1 test suite ran. (22492 ms total) 2024-04-06T03:36:53.533 INFO:tasks.workunit.client.0.smithi047.stdout: list: [ PASSED ] 3 tests. 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: pgmap v91: 884 pgs: 70 creating+peering, 693 active+clean, 121 unknown; 145 MiB data, 733 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: fourxx 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-4"}]': finished 2024-04-06T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: osdmap e90: 8 total, 8 up, 8 in 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: pgmap v91: 884 pgs: 70 creating+peering, 693 active+clean, 121 unknown; 145 MiB data, 733 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: fourxx 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-4"}]': finished 2024-04-06T03:36:53.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: osdmap e90: 8 total, 8 up, 8 in 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.748 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:53.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: pgmap v91: 884 pgs: 70 creating+peering, 693 active+clean, 121 unknown; 145 MiB data, 733 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/767036878' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: fourxx 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi047-74512-16"}]': finished 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi047-74684-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-4"}]': finished 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: osdmap e90: 8 total, 8 up, 8 in 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:53.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:36:53.837 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:36:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:36:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:36:54.599 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: Running main() from gmock_main.cc 2024-04-06T03:36:54.599 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-04-06T03:36:54.599 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [----------] Global test environment set-up. 2024-04-06T03:36:54.599 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-04-06T03:36:54.599 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-04-06T03:36:54.599 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (14774 ms) 2024-04-06T03:36:54.599 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-04-06T03:36:54.599 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (8817 ms) 2024-04-06T03:36:54.600 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (23591 ms total) 2024-04-06T03:36:54.600 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: 2024-04-06T03:36:54.600 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [----------] Global test environment tear-down 2024-04-06T03:36:54.600 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (23592 ms total) 2024-04-06T03:36:54.600 INFO:tasks.workunit.client.0.smithi047.stdout: ec_io: [ PASSED ] 2 tests. 2024-04-06T03:36:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-04-06T03:36:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:36:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-06T03:36:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: osdmap e91: 8 total, 8 up, 8 in 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3788945765' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi047-74473-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:36:54.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:54.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]: dispatch 2024-04-06T03:36:54.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:54.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-04-06T03:36:54.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:36:54.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:54.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:54.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: osdmap e91: 8 total, 8 up, 8 in 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3788945765' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi047-74473-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:54.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:54.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:36:54.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:36:54.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:54.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]: dispatch 2024-04-06T03:36:54.998 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi047-75691-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-4", "tierpool": "test-rados-api-smithi047-74676-4-cache"}]': finished 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:36:55.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: osdmap e91: 8 total, 8 up, 8 in 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi047-75582-2"}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3788945765' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi047-74473-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]: dispatch 2024-04-06T03:36:55.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout:admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.692545+0000 mon.a [INF] from='client.? 172.21.15.47:0/2810866142' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-4"}]: dispatch 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:51.692776+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: got: 2024-04-06T03:36:52.196144+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8612 ms) 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (24647 ms total) 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [----------] Global test environment tear-down 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (24647 ms total) 2024-04-06T03:36:55.467 INFO:tasks.workunit.client.0.smithi047.stdout: api_cmd: [ PASSED ] 4 tests. 2024-04-06T03:36:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: pgmap v94: 708 pgs: 11 creating+peering, 509 active+clean, 188 unknown; 145 MiB data, 733 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-04-06T03:36:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3788945765' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi047-74473-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-06T03:36:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:36:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4000924555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1334409741' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: osdmap e92: 8 total, 8 up, 8 in 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: pool 'PoolQuotaPP_smithi047-74496-3' is full (reached quota's max_bytes: 4 KiB) 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: osdmap e93: 8 total, 8 up, 8 in 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3495088016' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: pgmap v94: 708 pgs: 11 creating+peering, 509 active+clean, 188 unknown; 145 MiB data, 733 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3788945765' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi047-74473-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4000924555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1334409741' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: osdmap e92: 8 total, 8 up, 8 in 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: pool 'PoolQuotaPP_smithi047-74496-3' is full (reached quota's max_bytes: 4 KiB) 2024-04-06T03:36:56.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T03:36:56.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:36:56.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:36:56.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:36:56.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: osdmap e93: 8 total, 8 up, 8 in 2024-04-06T03:36:56.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3495088016' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: pgmap v94: 708 pgs: 11 creating+peering, 509 active+clean, 188 unknown; 145 MiB data, 733 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2316361600' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi047-75582-2"}]': finished 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3788945765' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi047-74473-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1186054676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/860523589' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4000924555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1334409741' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: osdmap e92: 8 total, 8 up, 8 in 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: pool 'PoolQuotaPP_smithi047-74496-3' is full (reached quota's max_bytes: 4 KiB) 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi047-75691-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi047-74936-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: osdmap e93: 8 total, 8 up, 8 in 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3495088016' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:56.458 INFO:tasks.workunit.client.0.smithi047.stdout: ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-06T03:36:56.458 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (4 ms) 2024-04-06T03:36:56.458 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-06T03:36:56.458 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (5 ms) 2024-04-06T03:36:56.458 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (4 ms) 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (6 ms) 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (4 ms) 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (3 ms) 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (9 ms) 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (4 ms) 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-04-06T03:36:56.459 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (4 ms) 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (3 ms) 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (3 ms) 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (2530 ms total) 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [----------] Global test environment tear-down 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (25813 ms total) 2024-04-06T03:36:56.460 INFO:tasks.workunit.client.0.smithi047.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-04-06T03:36:57.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:57.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]: dispatch 2024-04-06T03:36:57.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:57.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]': finished 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]': finished 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: osdmap e94: 8 total, 8 up, 8 in 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:36:57.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]: dispatch 2024-04-06T03:36:57.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]': finished 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]': finished 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: osdmap e94: 8 total, 8 up, 8 in 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:57.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:36:57.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:57.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:57.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]: dispatch 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]: dispatch 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi047-74684-1","app":"app1","key":"key1"}]': finished 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi047-74795-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74996-6", "pg_num": 4}]': finished 2024-04-06T03:36:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi047-74545-22"}]': finished 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: osdmap e94: 8 total, 8 up, 8 in 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:58.469 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: pgmap v97: 756 pgs: 130 creating+peering, 549 active+clean, 77 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: osdmap e95: 8 total, 8 up, 8 in 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/917609367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:58.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: pgmap v97: 756 pgs: 130 creating+peering, 549 active+clean, 77 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:36:58.471 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: osdmap e95: 8 total, 8 up, 8 in 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/917609367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:36:58.472 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:58.473 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:58.473 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:58.582 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: seed 74864 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (1302 ms) 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (23 ms) 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (38 ms) 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (315 ms) 2024-04-06T03:36:58.583 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (10 ms) 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (1688 ms total) 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (2172 ms) 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (22 ms) 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (10 ms) 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (2204 ms total) 2024-04-06T03:36:58.584 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: 2024-04-06T03:36:58.585 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-04-06T03:36:58.585 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (27823 ms total) 2024-04-06T03:36:58.585 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-04-06T03:36:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: pgmap v97: 756 pgs: 130 creating+peering, 549 active+clean, 77 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-04-06T03:36:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:36:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:36:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:36:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: osdmap e95: 8 total, 8 up, 8 in 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3511345765' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/917609367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1422481456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1670212820' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:36:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]: dispatch 2024-04-06T03:36:58.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:36:58.594 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: Running main() from gmock_main.cc 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [----------] Global test environment set-up. 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (76 ms) 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLock.LockShared (12 ms) 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1116 ms) 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1013 ms) 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-04-06T03:36:58.595 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (5 ms) 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLock.Unlock (148 ms) 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (33 ms) 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (57 ms) 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [----------] 8 tests from LibRadosLock (2460 ms total) 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (2455 ms) 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (4 ms) 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-04-06T03:36:58.596 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1086 ms) 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1004 ms) 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (3 ms) 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (4 ms) 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (4 ms) 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (3 ms) 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (4563 ms total) 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [----------] Global test environment tear-down 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (27920 ms total) 2024-04-06T03:36:58.597 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock: [ PASSED ] 16 tests. 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: Running main() from gmock_main.cc 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [----------] Global test environment set-up. 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStat.Stat (219 ms) 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (26 ms) 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStat.StatNS (62 ms) 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-04-06T03:36:58.598 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (7 ms) 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [----------] 5 tests from LibRadosStat (314 ms total) 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (2177 ms) 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (20 ms) 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1 ms) 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (1 ms) 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (2199 ms total) 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [----------] Global test environment tear-down 2024-04-06T03:36:58.599 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (27787 ms total) 2024-04-06T03:36:58.600 INFO:tasks.workunit.client.0.smithi047.stdout: api_stat: [ PASSED ] 9 tests. 2024-04-06T03:36:59.902 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-04-06T03:36:59.902 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: seed 74601 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (113 ms) 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (12 ms) 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1235 ms) 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1090 ms) 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (5 ms) 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-04-06T03:36:59.903 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (17 ms) 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (4 ms) 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (9 ms) 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2485 ms total) 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (2140 ms) 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (59 ms) 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1015 ms) 2024-04-06T03:36:59.904 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1021 ms) 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (3 ms) 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (4 ms) 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (4 ms) 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (2 ms) 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (4249 ms total) 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (29236 ms total) 2024-04-06T03:36:59.905 INFO:tasks.workunit.client.0.smithi047.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]': finished 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: osdmap e96: 8 total, 8 up, 8 in 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3298946231' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:00.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:00.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]: dispatch 2024-04-06T03:37:00.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:00.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]: dispatch 2024-04-06T03:37:00.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:37:00.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:00.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:37:00.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:36:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:00.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]': finished 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: osdmap e96: 8 total, 8 up, 8 in 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3298946231' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]: dispatch 2024-04-06T03:37:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]: dispatch 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi047-74473-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi047-74586-10"}]': finished 2024-04-06T03:37:00.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi047-74864-7"}]': finished 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "overlaypool": "test-rados-api-smithi047-74996-6"}]': finished 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi047-74999-7"}]': finished 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: osdmap e96: 8 total, 8 up, 8 in 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3298946231' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]: dispatch 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]: dispatch 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995578184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:00.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]: dispatch 2024-04-06T03:37:00.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:36:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:01.231 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: pgmap v100: 760 pgs: 112 creating+peering, 452 active+clean, 196 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-04-06T03:37:01.231 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:01.231 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3298946231' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:01.231 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:37:01.231 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]': finished 2024-04-06T03:37:01.231 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:37:01.231 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: osdmap e97: 8 total, 8 up, 8 in 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1933060982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.232 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: Running main() from gmock_main.cc 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [----------] Global test environment set-up. 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ OK ] NeoRadosPools.PoolList (10353 ms) 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (5444 ms) 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2760 ms) 2024-04-06T03:37:01.249 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-04-06T03:37:01.250 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (6845 ms) 2024-04-06T03:37:01.250 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-04-06T03:37:01.250 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2117 ms) 2024-04-06T03:37:01.250 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-04-06T03:37:01.250 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2677 ms) 2024-04-06T03:37:01.250 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [----------] 6 tests from NeoRadosPools (30196 ms total) 2024-04-06T03:37:01.250 INFO:tasks.workunit.client.0.smithi047.stdout: pool: 2024-04-06T03:37:01.251 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [----------] Global test environment tear-down 2024-04-06T03:37:01.251 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [==========] 6 tests from 1 test suite ran. (30196 ms total) 2024-04-06T03:37:01.251 INFO:tasks.workunit.client.0.smithi047.stdout: pool: [ PASSED ] 6 tests. 2024-04-06T03:37:01.259 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-04-06T03:37:01.259 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-04-06T03:37:01.259 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-04-06T03:37:01.259 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify_test_cb 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (1190 ms) 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94001616341648 err -107 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1175 ms) 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: waiting up to watch_notify2_test_errcb cookie 300 for disconnect notification ...94001616353632 err -107 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1055 ms) 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_cb from 24686 notify_id 347892350976 cookie 94001616353632 2024-04-06T03:37:01.260 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (38 ms) 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_cb from 24686 notify_id 347892350977 cookie 94001616353632 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (21 ms) 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_cb from 24686 notify_id 347892350978 cookie 94001616353632 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (30 ms) 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_cb from 24686 notify_id 347892350979 cookie 94001616353632 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_cb from 24686 notify_id 347892350979 cookie 94001616390496 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (15 ms) 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_cb from 24686 notify_id 347892350980 cookie 94001616353632 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_cb from 24686 notify_id 347892350981 cookie 94001616353632 2024-04-06T03:37:01.261 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3007 ms) 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94001616353632 err -107 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_cb from 24686 notify_id 377957122049 cookie 94001616353632 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5008 ms) 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94001616390416 err -107 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1004 ms) 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (12543 ms total) 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-04-06T03:37:01.262 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-04-06T03:37:01.263 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: watch_notify_test_cb 2024-04-06T03:37:01.263 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (2206 ms) 2024-04-06T03:37:01.263 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (2206 ms total) 2024-04-06T03:37:01.263 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: 2024-04-06T03:37:01.263 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-04-06T03:37:01.263 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (30463 ms total) 2024-04-06T03:37:01.263 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-04-06T03:37:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: pgmap v100: 760 pgs: 112 creating+peering, 452 active+clean, 196 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-04-06T03:37:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3298946231' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:37:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]': finished 2024-04-06T03:37:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:37:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: osdmap e97: 8 total, 8 up, 8 in 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1933060982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: pgmap v100: 760 pgs: 112 creating+peering, 452 active+clean, 196 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3298946231' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74996-6", "mode": "writeback"}]': finished 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi047-74601-10"}]': finished 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121148021' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/790808432' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: osdmap e97: 8 total, 8 up, 8 in 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1933060982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]: dispatch 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:01.632 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-04-06T03:37:01.632 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:37:01.632 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: data: 2024-04-06T03:37:01.632 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: pools: 32 pools, 964 pgs 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: objects: 230 objects, 582 KiB 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: pgs: 30.394% pgs unknown 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 46.680% pgs not active 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 450 creating+peering 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 293 unknown 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 221 active+clean 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:37:01.633 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: io: 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: client: 882 B/s rd, 0 op/s rd, 0 op/s wr 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ OK ] LibRadosService.StatusFormat (5590 ms) 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ RUN ] LibRadosService.Status 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ OK ] LibRadosService.Status (20054 ms) 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [----------] 4 tests from LibRadosService (30733 ms total) 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [----------] Global test environment tear-down 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [==========] 4 tests from 1 test suite ran. (30733 ms total) 2024-04-06T03:37:01.634 INFO:tasks.workunit.client.0.smithi047.stdout: api_service: [ PASSED ] 4 tests. 2024-04-06T03:37:02.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:37:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [----------] Global test environment set-up. 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5042 ms) 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (61 ms) 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20025 ms) 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: attempt 0 of 20 2024-04-06T03:37:02.300 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (6273 ms) 2024-04-06T03:37:02.301 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (31401 ms total) 2024-04-06T03:37:02.301 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: 2024-04-06T03:37:02.301 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [----------] Global test environment tear-down 2024-04-06T03:37:02.301 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (31401 ms total) 2024-04-06T03:37:02.301 INFO:tasks.workunit.client.0.smithi047.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-04-06T03:37:02.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: pgmap v103: 616 pgs: 32 creating+peering, 388 active+clean, 196 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3793407338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3223178375' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: osdmap e98: 8 total, 8 up, 8 in 2024-04-06T03:37:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:02.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:02.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3005458364' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-06T03:37:02.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: pgmap v103: 616 pgs: 32 creating+peering, 388 active+clean, 196 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:37:02.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:02.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:02.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:02.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:02.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:02.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:37:02.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3793407338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3223178375' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: osdmap e98: 8 total, 8 up, 8 in 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3005458364' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: pgmap v103: 616 pgs: 32 creating+peering, 388 active+clean, 196 unknown; 145 MiB data, 726 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:37:02.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]: dispatch 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi047-74936-12"}]': finished 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi047-74786-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3793407338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3223178375' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: osdmap e98: 8 total, 8 up, 8 in 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:02.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:02.747 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:02.747 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3005458364' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: notify 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (3326 ms) 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (11 ms) 2024-04-06T03:37:03.291 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (3337 ms total) 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: notify 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (161 ms) 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: notify 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (6425 ms) 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (21 ms) 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (11 ms) 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547575990080 notify_id 416611827718 notifier_gid 25105 2024-04-06T03:37:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (47 ms) 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576004528 notify_id 416611827712 notifier_gid 25105 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (45 ms) 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576004528 notify_id 416611827714 notifier_gid 25105 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (19 ms) 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576004528 notify_id 416611827715 notifier_gid 25105 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (27 ms) 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576004528 notify_id 416611827713 notifier_gid 25105 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (27 ms) 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576004528 notify_id 416611827716 notifier_gid 25105 2024-04-06T03:37:03.293 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (12 ms) 2024-04-06T03:37:03.294 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-04-06T03:37:03.294 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: trying... 2024-04-06T03:37:03.294 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576004528 notify_id 416611827717 notifier_gid 25105 2024-04-06T03:37:03.294 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: timed out 2024-04-06T03:37:03.294 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: flushing 2024-04-06T03:37:03.441 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: osdmap e99: 8 total, 8 up, 8 in 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: pgmap v106: 648 pgs: 87 creating+peering, 424 active+clean, 137 unknown; 145 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:03.442 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-06T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: osdmap e99: 8 total, 8 up, 8 in 2024-04-06T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:03.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: pgmap v106: 648 pgs: 87 creating+peering, 424 active+clean, 137 unknown; 145 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T03:37:03.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:03.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:03.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:03.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi047-75691-2"}]': finished 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi047-74473-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: osdmap e99: 8 total, 8 up, 8 in 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: pgmap v106: 648 pgs: 87 creating+peering, 424 active+clean, 137 unknown; 145 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:04.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:37:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:37:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: osdmap e100: 8 total, 8 up, 8 in 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1986951363' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:04.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:05.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:05.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: osdmap e100: 8 total, 8 up, 8 in 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1986951363' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:05.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi047-75691-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: osdmap e100: 8 total, 8 up, 8 in 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1986951363' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: pgmap v108: 616 pgs: 32 creating+peering, 392 active+clean, 192 unknown; 145 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:37:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: osdmap e101: 8 total, 8 up, 8 in 2024-04-06T03:37:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/205962308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2247676118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: osdmap e102: 8 total, 8 up, 8 in 2024-04-06T03:37:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2030668742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:06.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:06.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: pgmap v108: 616 pgs: 32 creating+peering, 392 active+clean, 192 unknown; 145 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:37:06.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: osdmap e101: 8 total, 8 up, 8 in 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/205962308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2247676118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:06.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: osdmap e102: 8 total, 8 up, 8 in 2024-04-06T03:37:06.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2030668742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:06.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.499 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: pgmap v108: 616 pgs: 32 creating+peering, 392 active+clean, 192 unknown; 145 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: osdmap e101: 8 total, 8 up, 8 in 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/205962308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2247676118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi047-75691-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi047-74473-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: osdmap e102: 8 total, 8 up, 8 in 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2030668742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: pgmap v111: 624 pgs: 28 creating+peering, 544 active+clean, 52 unknown; 145 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-04-06T03:37:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]': finished 2024-04-06T03:37:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: osdmap e103: 8 total, 8 up, 8 in 2024-04-06T03:37:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:07.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:07.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:37:07.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:37:07.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:07.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: pgmap v111: 624 pgs: 28 creating+peering, 544 active+clean, 52 unknown; 145 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-04-06T03:37:07.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]': finished 2024-04-06T03:37:07.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:07.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: osdmap e103: 8 total, 8 up, 8 in 2024-04-06T03:37:07.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:07.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:07.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:07.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:07.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:37:07.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:37:07.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:07 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:08.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: pgmap v111: 624 pgs: 28 creating+peering, 544 active+clean, 52 unknown; 145 MiB data, 785 MiB used, 714 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-7"}]': finished 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: osdmap e103: 8 total, 8 up, 8 in 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:37:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:07 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:09.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:09 smithi102 ceph-mon[32821]: osdmap e104: 8 total, 8 up, 8 in 2024-04-06T03:37:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3196405762' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:09.646 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:09.646 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[37680]: osdmap e104: 8 total, 8 up, 8 in 2024-04-06T03:37:09.646 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:09.646 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3196405762' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:09.646 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:09.646 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:09.646 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:09.647 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:09.647 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[29365]: osdmap e104: 8 total, 8 up, 8 in 2024-04-06T03:37:09.647 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:09.647 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3196405762' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:09.647 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:09.647 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]: dispatch 2024-04-06T03:37:09.647 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:10.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: pgmap v114: 592 pgs: 8 creating+peering, 456 active+clean, 128 unknown; 145 MiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]': finished 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: osdmap e105: 8 total, 8 up, 8 in 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2746931384' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: osdmap e106: 8 total, 8 up, 8 in 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2161664660' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: pgmap v114: 592 pgs: 8 creating+peering, 456 active+clean, 128 unknown; 145 MiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]': finished 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: osdmap e105: 8 total, 8 up, 8 in 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2746931384' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: osdmap e106: 8 total, 8 up, 8 in 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:10.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2161664660' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: pgmap v114: 592 pgs: 8 creating+peering, 456 active+clean, 128 unknown; 145 MiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi047-74473-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-7"}]': finished 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: osdmap e105: 8 total, 8 up, 8 in 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2746931384' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-75126-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: osdmap e106: 8 total, 8 up, 8 in 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2161664660' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3259852539' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: pgmap v117: 584 pgs: 424 active+clean, 160 unknown; 145 MiB data, 794 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: osdmap e107: 8 total, 8 up, 8 in 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:12.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3259852539' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: pgmap v117: 584 pgs: 424 active+clean, 160 unknown; 145 MiB data, 794 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: osdmap e107: 8 total, 8 up, 8 in 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:12.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3259852539' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: pgmap v117: 584 pgs: 424 active+clean, 160 unknown; 145 MiB data, 794 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi047-74496-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: osdmap e107: 8 total, 8 up, 8 in 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:12.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/991102233' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:12.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:13.076 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: Running main() from gmock_main.cc 2024-04-06T03:37:13.076 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-04-06T03:37:13.076 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [----------] Global test environment set-up. 2024-04-06T03:37:13.076 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-04-06T03:37:13.076 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (19105 ms) 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (12168 ms) 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (10766 ms) 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [----------] 3 tests from NeoradosECList (42039 ms total) 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [----------] Global test environment tear-down 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (42040 ms total) 2024-04-06T03:37:13.077 INFO:tasks.workunit.client.0.smithi047.stdout: ec_list: [ PASSED ] 3 tests. 2024-04-06T03:37:13.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:13 smithi102 ceph-mon[32821]: osdmap e108: 8 total, 8 up, 8 in 2024-04-06T03:37:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]: dispatch 2024-04-06T03:37:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[29365]: osdmap e108: 8 total, 8 up, 8 in 2024-04-06T03:37:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]: dispatch 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[37680]: osdmap e108: 8 total, 8 up, 8 in 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]: dispatch 2024-04-06T03:37:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]: dispatch 2024-04-06T03:37:14.251 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:37:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:37:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:37:14.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: pgmap v120: 680 pgs: 64 creating+peering, 520 active+clean, 96 unknown; 145 MiB data, 758 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-04-06T03:37:14.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:14.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: osdmap e109: 8 total, 8 up, 8 in 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3772078664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4264156125' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:37:14.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: 13.8 deep-scrub starts 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: 13.7 deep-scrub starts 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: 13.8 deep-scrub ok 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: 13.7 deep-scrub ok 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: 13.4 deep-scrub starts 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: 13.4 deep-scrub ok 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: 13.3 deep-scrub starts 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:14.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: 13.3 deep-scrub ok 2024-04-06T03:37:14.254 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:14.256 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: pgmap v120: 680 pgs: 64 creating+peering, 520 active+clean, 96 unknown; 145 MiB data, 758 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-04-06T03:37:14.256 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:14.256 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]: dispatch 2024-04-06T03:37:14.256 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:14.256 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: osdmap e109: 8 total, 8 up, 8 in 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3772078664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4264156125' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:37:14.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: 13.8 deep-scrub starts 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: 13.7 deep-scrub starts 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: 13.8 deep-scrub ok 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: 13.7 deep-scrub ok 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: 13.4 deep-scrub starts 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: 13.4 deep-scrub ok 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: 13.3 deep-scrub starts 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: 13.3 deep-scrub ok 2024-04-06T03:37:14.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: pgmap v120: 680 pgs: 64 creating+peering, 520 active+clean, 96 unknown; 145 MiB data, 758 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]: dispatch 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi047-75691-3"}]': finished 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: osdmap e109: 8 total, 8 up, 8 in 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3772078664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4264156125' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:37:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: 13.8 deep-scrub starts 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: 13.7 deep-scrub starts 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: 13.8 deep-scrub ok 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: 13.7 deep-scrub ok 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: 13.4 deep-scrub starts 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: 13.4 deep-scrub ok 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: 13.3 deep-scrub starts 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: 13.3 deep-scrub ok 2024-04-06T03:37:14.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:37:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:37:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:37:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: 13.6 deep-scrub starts 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: 13.6 deep-scrub ok 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]': finished 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]': finished 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: osdmap e110: 8 total, 8 up, 8 in 2024-04-06T03:37:15.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]: dispatch 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]: dispatch 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: 13.0 deep-scrub starts 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: 13.0 deep-scrub ok 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: 13.1 deep-scrub starts 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: 13.1 deep-scrub ok 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:37:15.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: 13.6 deep-scrub starts 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: 13.6 deep-scrub ok 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]': finished 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]': finished 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: osdmap e110: 8 total, 8 up, 8 in 2024-04-06T03:37:15.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]: dispatch 2024-04-06T03:37:15.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:37:15.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]: dispatch 2024-04-06T03:37:15.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:37:15.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: 13.0 deep-scrub starts 2024-04-06T03:37:15.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: 13.0 deep-scrub ok 2024-04-06T03:37:15.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: 13.1 deep-scrub starts 2024-04-06T03:37:15.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: 13.1 deep-scrub ok 2024-04-06T03:37:15.499 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:15.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: 13.6 deep-scrub starts 2024-04-06T03:37:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: 13.6 deep-scrub ok 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4"}]': finished 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-9"}]': finished 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi047-74473-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi047-74496-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: osdmap e110: 8 total, 8 up, 8 in 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]: dispatch 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]: dispatch 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]: dispatch 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: 13.0 deep-scrub starts 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: 13.0 deep-scrub ok 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: 13.1 deep-scrub starts 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: 13.1 deep-scrub ok 2024-04-06T03:37:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:15.789 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-04-06T03:37:15.789 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-04-06T03:37:15.789 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-04-06T03:37:15.789 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-04-06T03:37:15.789 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-04-06T03:37:15.789 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (11759 ms) 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (6993 ms) 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3880 ms) 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (5071 ms) 2024-04-06T03:37:15.790 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-04-06T03:37:15.791 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (4903 ms) 2024-04-06T03:37:15.791 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-04-06T03:37:15.791 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (4196 ms) 2024-04-06T03:37:15.791 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-04-06T03:37:15.791 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (8131 ms) 2024-04-06T03:37:15.793 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (44933 ms total) 2024-04-06T03:37:15.793 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: 2024-04-06T03:37:15.793 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-04-06T03:37:15.793 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (44933 ms total) 2024-04-06T03:37:15.793 INFO:tasks.workunit.client.0.smithi047.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-04-06T03:37:16.945 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: flushed 2024-04-06T03:37:16.945 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3023 ms) 2024-04-06T03:37:16.945 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: trying... 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576023776 notify_id 425201762311 notifier_gid 25105 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: timed out 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: flushing 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: flushed 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3011 ms) 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: List watches 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: notify2 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576004528 notify_id 438086664198 notifier_gid 25105 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: notify2 done 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: watch_check 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: unwatch2 2024-04-06T03:37:16.946 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: flushing 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: done 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3012 ms) 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: List watches 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: notify2 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: handle_notify cookie 94547576004528 notify_id 450971566087 notifier_gid 25105 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: notify2 done 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: watch_check 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: unwatch2 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: flushing 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: done 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3026 ms) 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (18867 ms total) 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: 2024-04-06T03:37:16.947 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-04-06T03:37:16.948 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (46136 ms total) 2024-04-06T03:37:16.948 INFO:tasks.workunit.client.0.smithi047.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-04-06T03:37:17.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: 13.2 deep-scrub starts 2024-04-06T03:37:17.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: 13.2 deep-scrub ok 2024-04-06T03:37:17.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: pgmap v123: 680 pgs: 32 creating+peering, 488 active+clean, 160 unknown; 145 MiB data, 758 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-04-06T03:37:17.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: 13.5 deep-scrub starts 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: 13.5 deep-scrub ok 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]': finished 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]': finished 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: osdmap e111: 8 total, 8 up, 8 in 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1619273443' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:17.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: 13.2 deep-scrub starts 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: 13.2 deep-scrub ok 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: pgmap v123: 680 pgs: 32 creating+peering, 488 active+clean, 160 unknown; 145 MiB data, 758 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: 13.5 deep-scrub starts 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: 13.5 deep-scrub ok 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]': finished 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]': finished 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: osdmap e111: 8 total, 8 up, 8 in 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1619273443' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:17.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:17.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:17.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:17.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: 13.2 deep-scrub starts 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: 13.2 deep-scrub ok 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: pgmap v123: 680 pgs: 32 creating+peering, 488 active+clean, 160 unknown; 145 MiB data, 758 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: 13.5 deep-scrub starts 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: 13.5 deep-scrub ok 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-9", "mode": "writeback"}]': finished 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi047-74996-4", "tierpool": "test-rados-api-smithi047-74996-6"}]': finished 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: osdmap e111: 8 total, 8 up, 8 in 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/572458338' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1619273443' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:17.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:17.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:17.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:17.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: 13.9 deep-scrub starts 2024-04-06T03:37:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: 13.9 deep-scrub ok 2024-04-06T03:37:18.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T03:37:18.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:18.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:18.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: osdmap e112: 8 total, 8 up, 8 in 2024-04-06T03:37:18.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:18.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:18.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:18.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:18.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: pgmap v126: 548 pgs: 33 creating+peering, 482 active+clean, 33 unknown; 217 MiB data, 954 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:18.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:37:18.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:18.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]': finished 2024-04-06T03:37:18.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:18.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: osdmap e113: 8 total, 8 up, 8 in 2024-04-06T03:37:18.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:18.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:18.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1740469103' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:18.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3601797106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi047-74496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:18.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: 13.9 deep-scrub starts 2024-04-06T03:37:18.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: 13.9 deep-scrub ok 2024-04-06T03:37:18.249 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T03:37:18.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:18.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:18.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: osdmap e112: 8 total, 8 up, 8 in 2024-04-06T03:37:18.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:18.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:18.250 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:18.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:18.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: pgmap v126: 548 pgs: 33 creating+peering, 482 active+clean, 33 unknown; 217 MiB data, 954 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:18.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:37:18.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:18.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]': finished 2024-04-06T03:37:18.251 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:18.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: osdmap e113: 8 total, 8 up, 8 in 2024-04-06T03:37:18.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:18.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:18.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1740469103' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:18.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.252 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3601797106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi047-74496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.253 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: 13.9 deep-scrub starts 2024-04-06T03:37:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: 13.9 deep-scrub ok 2024-04-06T03:37:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi047-74996-6", "pool2": "test-rados-api-smithi047-74996-6", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T03:37:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: osdmap e112: 8 total, 8 up, 8 in 2024-04-06T03:37:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]: dispatch 2024-04-06T03:37:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: pgmap v126: 548 pgs: 33 creating+peering, 482 active+clean, 33 unknown; 217 MiB data, 954 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:37:18.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:18.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-9"}]': finished 2024-04-06T03:37:18.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:18.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: osdmap e113: 8 total, 8 up, 8 in 2024-04-06T03:37:18.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:18.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:18.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1740469103' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:18.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3601797106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi047-74496-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:18.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3601797106' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi047-74496-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[29365]: osdmap e114: 8 total, 8 up, 8 in 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3601797106' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi047-74496-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[37680]: osdmap e114: 8 total, 8 up, 8 in 2024-04-06T03:37:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: Running main() from gmock_main.cc 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [----------] Global test environment set-up. 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (11536 ms) 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (6993 ms) 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-04-06T03:37:19.281 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (5525 ms) 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3447 ms) 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (6936 ms) 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (4395 ms) 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (9371 ms) 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (48203 ms total) 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [----------] Global test environment tear-down 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (48204 ms total) 2024-04-06T03:37:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: write_operations: [ PASSED ] 7 tests. 2024-04-06T03:37:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi047-74473-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3601797106' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi047-74496-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:18 smithi102 ceph-mon[32821]: osdmap e114: 8 total, 8 up, 8 in 2024-04-06T03:37:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:20.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[29365]: pgmap v129: 548 pgs: 128 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[29365]: osdmap e115: 8 total, 8 up, 8 in 2024-04-06T03:37:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[37680]: pgmap v129: 548 pgs: 128 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[37680]: osdmap e115: 8 total, 8 up, 8 in 2024-04-06T03:37:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:20.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:20 smithi102 ceph-mon[32821]: pgmap v129: 548 pgs: 128 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:20 smithi102 ceph-mon[32821]: osdmap e115: 8 total, 8 up, 8 in 2024-04-06T03:37:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] Global test environment set-up. 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: 2024-04-06T03:36:30.772+0000 7fbb71160780 -1 failed for service _ceph-mon._tcp 2024-04-06T03:37:20.794 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: 2024-04-06T03:36:30.772+0000 7fbb71160780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (63 ms) 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2010 ms) 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2073 ms total) 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: started 0x56103ad7e630 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: started 0x56103af79560 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: started 2 aios 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: waiting 0x56103ad7e630 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: waiting 0x56103af79560 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: done. 2024-04-06T03:37:20.795 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (13002 ms) 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (13002 ms total) 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMisc.Exec (116 ms) 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (10 ms) 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (6 ms) 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMisc.Applications (7268 ms) 2024-04-06T03:37:20.796 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-04-06T03:37:20.797 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-04-06T03:37:20.797 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-04-06T03:37:20.797 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-04-06T03:37:20.797 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-04-06T03:37:20.797 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (23752 ms) 2024-04-06T03:37:20.797 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] 8 tests from LibRadosMisc (31152 ms total) 2024-04-06T03:37:20.797 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: 2024-04-06T03:37:20.797 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [----------] Global test environment tear-down 2024-04-06T03:37:20.798 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (50058 ms total) 2024-04-06T03:37:20.798 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc: [ PASSED ] 12 tests. 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: osdmap e116: 8 total, 8 up, 8 in 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2605993374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2396411963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: osdmap e117: 8 total, 8 up, 8 in 2024-04-06T03:37:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:21.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:21.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:21.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: osdmap e116: 8 total, 8 up, 8 in 2024-04-06T03:37:21.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2605993374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2396411963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: osdmap e117: 8 total, 8 up, 8 in 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:21.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi047-74795-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: osdmap e116: 8 total, 8 up, 8 in 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2605993374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2396411963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi047-74473-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi047-74496-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74869-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: osdmap e117: 8 total, 8 up, 8 in 2024-04-06T03:37:21.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:21.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:22.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:37:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: pgmap v132: 588 pgs: 232 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: osdmap e118: 8 total, 8 up, 8 in 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]: dispatch 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]: dispatch 2024-04-06T03:37:22.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: pgmap v132: 588 pgs: 232 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: osdmap e118: 8 total, 8 up, 8 in 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]: dispatch 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]: dispatch 2024-04-06T03:37:22.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: pgmap v132: 588 pgs: 232 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: osdmap e118: 8 total, 8 up, 8 in 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]: dispatch 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]: dispatch 2024-04-06T03:37:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:23.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:23.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: pgmap v135: 492 pgs: 96 unknown, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 256 KiB/s wr, 1 op/s 2024-04-06T03:37:23.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]': finished 2024-04-06T03:37:23.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]': finished 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: osdmap e119: 8 total, 8 up, 8 in 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]: dispatch 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2335309843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]: dispatch 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1757188091' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi047-74473-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: pgmap v135: 492 pgs: 96 unknown, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 256 KiB/s wr, 1 op/s 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]': finished 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]': finished 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: osdmap e119: 8 total, 8 up, 8 in 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2335309843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1757188091' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi047-74473-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: pgmap v135: 492 pgs: 96 unknown, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 256 KiB/s wr, 1 op/s 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-11"}]': finished 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache", "force_nonempty":""}]': finished 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: osdmap e119: 8 total, 8 up, 8 in 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]: dispatch 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2335309843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]: dispatch 2024-04-06T03:37:23.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1757188091' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi047-74473-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:23.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:37:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:37:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:37:24.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]': finished 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1757188091' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi047-74473-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: osdmap e120: 8 total, 8 up, 8 in 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]: dispatch 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]: dispatch 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:24.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]': finished 2024-04-06T03:37:24.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1757188091' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi047-74473-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: osdmap e120: 8 total, 8 up, 8 in 2024-04-06T03:37:24.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]: dispatch 2024-04-06T03:37:24.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]: dispatch 2024-04-06T03:37:24.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:24.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74869-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-11", "mode": "writeback"}]': finished 2024-04-06T03:37:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1757188091' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi047-74473-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: osdmap e120: 8 total, 8 up, 8 in 2024-04-06T03:37:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/447128156' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]: dispatch 2024-04-06T03:37:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]: dispatch 2024-04-06T03:37:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: Running main() from gmock_main.cc 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [----------] Global test environment set-up. 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.Version (10357 ms) 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (5439 ms) 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-04-06T03:37:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.LongName (4064 ms) 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (4218 ms) 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (7169 ms) 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3241 ms) 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.Exec (4365 ms) 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3153 ms) 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (2740 ms) 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-04-06T03:37:24.879 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.BigObject (4383 ms) 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (1613 ms) 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3083 ms) 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [----------] 12 tests from NeoRadosMisc (53825 ms total) 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [----------] Global test environment tear-down 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [==========] 12 tests from 1 test suite ran. (53825 ms total) 2024-04-06T03:37:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: misc: [ PASSED ] 12 tests. 2024-04-06T03:37:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: pgmap v138: 556 pgs: 160 unknown, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 257 KiB/s wr, 2 op/s 2024-04-06T03:37:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]': finished 2024-04-06T03:37:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: osdmap e121: 8 total, 8 up, 8 in 2024-04-06T03:37:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: osdmap e122: 8 total, 8 up, 8 in 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3094907301' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi047-74473-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1638256486' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi047-74496-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: pgmap v138: 556 pgs: 160 unknown, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 257 KiB/s wr, 2 op/s 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]': finished 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: osdmap e121: 8 total, 8 up, 8 in 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: osdmap e122: 8 total, 8 up, 8 in 2024-04-06T03:37:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3094907301' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi047-74473-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1638256486' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi047-74496-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:26.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: pgmap v138: 556 pgs: 160 unknown, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 257 KiB/s wr, 2 op/s 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74869-10", "tierpool":"test-rados-api-smithi047-74869-10-cache"}]': finished 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: osdmap e121: 8 total, 8 up, 8 in 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: osdmap e122: 8 total, 8 up, 8 in 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]: dispatch 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3094907301' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi047-74473-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1638256486' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi047-74496-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:26.775 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: Running main() from gmock_main.cc 2024-04-06T03:37:26.775 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-04-06T03:37:26.775 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [----------] Global test environment set-up. 2024-04-06T03:37:26.775 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-04-06T03:37:26.775 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-04-06T03:37:26.775 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolList (10637 ms) 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (6842 ms) 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (5223 ms) 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (4061 ms) 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3725 ms) 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (6392 ms) 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (6405 ms) 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5221 ms) 2024-04-06T03:37:26.776 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-04-06T03:37:26.777 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (7491 ms) 2024-04-06T03:37:26.777 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [----------] 9 tests from LibRadosPools (55998 ms total) 2024-04-06T03:37:26.777 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: 2024-04-06T03:37:26.777 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [----------] Global test environment tear-down 2024-04-06T03:37:26.777 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (55999 ms total) 2024-04-06T03:37:26.777 INFO:tasks.workunit.client.0.smithi047.stdout: api_pool: [ PASSED ] 9 tests. 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]': finished 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3094907301' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi047-74473-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1638256486' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi047-74496-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[29365]: osdmap e123: 8 total, 8 up, 8 in 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:37:27.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]': finished 2024-04-06T03:37:27.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3094907301' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi047-74473-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:27.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1638256486' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi047-74496-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:27.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:27 smithi047 ceph-mon[37680]: osdmap e123: 8 total, 8 up, 8 in 2024-04-06T03:37:27.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:27.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:27 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:37:27.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-11"}]': finished 2024-04-06T03:37:27.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3094907301' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi047-74473-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:27.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1638256486' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi047-74496-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:27.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:27 smithi102 ceph-mon[32821]: osdmap e123: 8 total, 8 up, 8 in 2024-04-06T03:37:29.066 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[37680]: pgmap v141: 556 pgs: 53 creating+peering, 20 unknown, 483 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-04-06T03:37:29.066 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:29.066 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[37680]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:29.066 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[37680]: osdmap e124: 8 total, 8 up, 8 in 2024-04-06T03:37:29.066 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:29.067 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[29365]: pgmap v141: 556 pgs: 53 creating+peering, 20 unknown, 483 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-04-06T03:37:29.067 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:29.067 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[29365]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:29.067 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[29365]: osdmap e124: 8 total, 8 up, 8 in 2024-04-06T03:37:29.067 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:29.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:28 smithi102 ceph-mon[32821]: pgmap v141: 556 pgs: 53 creating+peering, 20 unknown, 483 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-04-06T03:37:29.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:29.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:28 smithi102 ceph-mon[32821]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:28 smithi102 ceph-mon[32821]: osdmap e124: 8 total, 8 up, 8 in 2024-04-06T03:37:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:30.095 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: pgmap v144: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:37:30.096 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: osdmap e125: 8 total, 8 up, 8 in 2024-04-06T03:37:30.096 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.096 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.096 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2306550089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.096 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3252147045' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.096 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.096 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.096 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: pgmap v144: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: osdmap e125: 8 total, 8 up, 8 in 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2306550089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3252147045' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: pgmap v144: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: osdmap e125: 8 total, 8 up, 8 in 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2306550089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3252147045' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:31.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: osdmap e126: 8 total, 8 up, 8 in 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: osdmap e127: 8 total, 8 up, 8 in 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: osdmap e126: 8 total, 8 up, 8 in 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: osdmap e127: 8 total, 8 up, 8 in 2024-04-06T03:37:31.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi047-74496-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi047-74473-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: osdmap e126: 8 total, 8 up, 8 in 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: osdmap e127: 8 total, 8 up, 8 in 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2944637045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:31.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]: dispatch 2024-04-06T03:37:32.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:37:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:37:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: pgmap v147: 452 pgs: 128 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: osdmap e128: 8 total, 8 up, 8 in 2024-04-06T03:37:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/161032784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1670062531' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: pgmap v147: 452 pgs: 128 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: osdmap e128: 8 total, 8 up, 8 in 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/161032784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1670062531' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: pgmap v147: 452 pgs: 128 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi047-74795-10"}]': finished 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: osdmap e128: 8 total, 8 up, 8 in 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/161032784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1670062531' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:32.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:32.786 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: Running main() from gmock_main.cc 2024-04-06T03:37:32.786 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-04-06T03:37:32.786 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [----------] Global test environment set-up. 2024-04-06T03:37:32.786 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-04-06T03:37:32.786 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (11553 ms) 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (5650 ms) 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (5216 ms) 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (5072 ms) 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (4901 ms) 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (4204 ms) 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (4292 ms) 2024-04-06T03:37:32.787 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (3137 ms) 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (2851 ms) 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (2835 ms) 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (3105 ms) 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (2903 ms) 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3051 ms) 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2952 ms) 2024-04-06T03:37:32.788 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (61724 ms total) 2024-04-06T03:37:32.789 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: 2024-04-06T03:37:32.789 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [----------] Global test environment tear-down 2024-04-06T03:37:32.789 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (61724 ms total) 2024-04-06T03:37:32.789 INFO:tasks.workunit.client.0.smithi047.stdout: read_operations: [ PASSED ] 14 tests. 2024-04-06T03:37:33.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:37:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:37:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: pgmap v150: 516 pgs: 64 unknown, 64 creating+peering, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 51 KiB/s wr, 52 op/s 2024-04-06T03:37:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: osdmap e129: 8 total, 8 up, 8 in 2024-04-06T03:37:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[29365]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: pgmap v150: 516 pgs: 64 unknown, 64 creating+peering, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 51 KiB/s wr, 52 op/s 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: osdmap e129: 8 total, 8 up, 8 in 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:33.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:33.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:33 smithi047 ceph-mon[37680]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: pgmap v150: 516 pgs: 64 unknown, 64 creating+peering, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 51 KiB/s wr, 52 op/s 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi047-74473-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi047-74496-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: osdmap e129: 8 total, 8 up, 8 in 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:33 smithi102 ceph-mon[32821]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:34 smithi102 ceph-mon[32821]: osdmap e130: 8 total, 8 up, 8 in 2024-04-06T03:37:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:35.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:35.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:34 smithi047 ceph-mon[29365]: osdmap e130: 8 total, 8 up, 8 in 2024-04-06T03:37:35.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:35.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:35.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:35.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:34 smithi047 ceph-mon[37680]: osdmap e130: 8 total, 8 up, 8 in 2024-04-06T03:37:35.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:35.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:37:35.778 INFO:tasks.workunit.client.0.smithi047.stdout: io: Running main() from gmock_main.cc 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [----------] Global test environment set-up. 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [----------] 14 tests from NeoRadosIo 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.Limits (12640 ms) 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (5961 ms) 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.ReadOp (6850 ms) 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.SparseRead (5862 ms) 2024-04-06T03:37:35.779 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.RoundTrip (3925 ms) 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (3663 ms) 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (4168 ms) 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (3880 ms) 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (2820 ms) 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.Trunc (3100 ms) 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.Remove (2903 ms) 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-04-06T03:37:35.780 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3053 ms) 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.RmXattr (2955 ms) 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ OK ] NeoRadosIo.GetXattrs (2994 ms) 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: [----------] 14 tests from NeoRadosIo (64774 ms total) 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: [----------] Global test environment tear-down 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: [==========] 14 tests from 1 test suite ran. (64774 ms total) 2024-04-06T03:37:35.781 INFO:tasks.workunit.client.0.smithi047.stdout: io: [ PASSED ] 14 tests. 2024-04-06T03:37:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: pgmap v153: 420 pgs: 32 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 52 KiB/s wr, 54 op/s 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: osdmap e131: 8 total, 8 up, 8 in 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/736009875' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1095898926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi047-74473-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]': finished 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1095898926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi047-74473-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: osdmap e132: 8 total, 8 up, 8 in 2024-04-06T03:37:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]: dispatch 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: pgmap v153: 420 pgs: 32 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 52 KiB/s wr, 54 op/s 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: osdmap e131: 8 total, 8 up, 8 in 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/736009875' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1095898926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi047-74473-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]': finished 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1095898926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi047-74473-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: osdmap e132: 8 total, 8 up, 8 in 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]: dispatch 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: pgmap v153: 420 pgs: 32 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 52 KiB/s wr, 54 op/s 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi047-74795-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: osdmap e131: 8 total, 8 up, 8 in 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:37:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/736009875' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1095898926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi047-74473-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-13"}]': finished 2024-04-06T03:37:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi047-74496-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1095898926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi047-74473-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: osdmap e132: 8 total, 8 up, 8 in 2024-04-06T03:37:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]: dispatch 2024-04-06T03:37:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:36 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]: dispatch 2024-04-06T03:37:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:37.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:36 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:37.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:36 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]': finished 2024-04-06T03:37:37.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:36 smithi102 ceph-mon[32821]: osdmap e133: 8 total, 8 up, 8 in 2024-04-06T03:37:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]: dispatch 2024-04-06T03:37:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]': finished 2024-04-06T03:37:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[37680]: osdmap e133: 8 total, 8 up, 8 in 2024-04-06T03:37:37.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]: dispatch 2024-04-06T03:37:37.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:37.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:37:37.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-13", "mode": "writeback"}]': finished 2024-04-06T03:37:37.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:36 smithi047 ceph-mon[29365]: osdmap e133: 8 total, 8 up, 8 in 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: pgmap v156: 428 pgs: 14 unknown, 414 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 64 KiB/s wr, 63 op/s 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.0"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.1"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.2"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.3"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.4"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.5"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.6"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.7"}]: dispatch 2024-04-06T03:37:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.8"}]: dispatch 2024-04-06T03:37:38.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.9"}]: dispatch 2024-04-06T03:37:38.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: 168.3 deep-scrub starts 2024-04-06T03:37:38.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: 168.3 deep-scrub ok 2024-04-06T03:37:38.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: osdmap e134: 8 total, 8 up, 8 in 2024-04-06T03:37:38.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2001448232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1932855093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: pgmap v156: 428 pgs: 14 unknown, 414 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 64 KiB/s wr, 63 op/s 2024-04-06T03:37:38.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:38.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.0"}]: dispatch 2024-04-06T03:37:38.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.1"}]: dispatch 2024-04-06T03:37:38.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.2"}]: dispatch 2024-04-06T03:37:38.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.3"}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.4"}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.5"}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.6"}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.7"}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.8"}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.9"}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: 168.3 deep-scrub starts 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: 168.3 deep-scrub ok 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: osdmap e134: 8 total, 8 up, 8 in 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2001448232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1932855093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: pgmap v156: 428 pgs: 14 unknown, 414 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 64 KiB/s wr, 63 op/s 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.0"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.1"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.2"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.3"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.4"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.5"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.6"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.7"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.8"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "168.9"}]: dispatch 2024-04-06T03:37:38.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: 168.3 deep-scrub starts 2024-04-06T03:37:38.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: 168.3 deep-scrub ok 2024-04-06T03:37:38.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: osdmap e134: 8 total, 8 up, 8 in 2024-04-06T03:37:38.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2001448232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1932855093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:38.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:39.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.0"}]: dispatch 2024-04-06T03:37:39.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.1"}]: dispatch 2024-04-06T03:37:39.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.2"}]: dispatch 2024-04-06T03:37:39.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.3"}]: dispatch 2024-04-06T03:37:39.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.4"}]: dispatch 2024-04-06T03:37:39.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.5"}]: dispatch 2024-04-06T03:37:39.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.6"}]: dispatch 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.7"}]: dispatch 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.8"}]: dispatch 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.9"}]: dispatch 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: 168.4 deep-scrub starts 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: 168.4 deep-scrub ok 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: 168.2 scrub starts 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: 168.2 scrub ok 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: 168.6 scrub starts 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: 168.6 scrub ok 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: 168.8 scrub starts 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: 168.8 scrub ok 2024-04-06T03:37:39.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:39.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:39.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:38 smithi102 ceph-mon[32821]: osdmap e135: 8 total, 8 up, 8 in 2024-04-06T03:37:39.141 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.0"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.1"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.2"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.3"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.4"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.5"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.6"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.7"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.8"}]: dispatch 2024-04-06T03:37:39.142 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.9"}]: dispatch 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: 168.4 deep-scrub starts 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: 168.4 deep-scrub ok 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: 168.2 scrub starts 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: 168.2 scrub ok 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: 168.6 scrub starts 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: 168.6 scrub ok 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: 168.8 scrub starts 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: 168.8 scrub ok 2024-04-06T03:37:39.143 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[37680]: osdmap e135: 8 total, 8 up, 8 in 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.0"}]: dispatch 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.1"}]: dispatch 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.2"}]: dispatch 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.3"}]: dispatch 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.4"}]: dispatch 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.5"}]: dispatch 2024-04-06T03:37:39.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.6"}]: dispatch 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.7"}]: dispatch 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.8"}]: dispatch 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "168.9"}]: dispatch 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: 168.4 deep-scrub starts 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: 168.4 deep-scrub ok 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: 168.2 scrub starts 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: 168.2 scrub ok 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: 168.6 scrub starts 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: 168.6 scrub ok 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: 168.8 scrub starts 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: 168.8 scrub ok 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi047-74473-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:39.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi047-74496-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:39.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:38 smithi047 ceph-mon[29365]: osdmap e135: 8 total, 8 up, 8 in 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: 168.1 deep-scrub starts 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: 168.1 deep-scrub ok 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: 168.0 scrub starts 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: 168.0 scrub ok 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: pgmap v159: 460 pgs: 96 unknown, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 74 KiB/s wr, 73 op/s 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: 168.7 scrub starts 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: 168.7 scrub ok 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:39 smithi102 ceph-mon[32821]: osdmap e136: 8 total, 8 up, 8 in 2024-04-06T03:37:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: 168.1 deep-scrub starts 2024-04-06T03:37:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: 168.1 deep-scrub ok 2024-04-06T03:37:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: 168.0 scrub starts 2024-04-06T03:37:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: 168.0 scrub ok 2024-04-06T03:37:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: pgmap v159: 460 pgs: 96 unknown, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 74 KiB/s wr, 73 op/s 2024-04-06T03:37:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: 168.7 scrub starts 2024-04-06T03:37:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: 168.7 scrub ok 2024-04-06T03:37:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[29365]: osdmap e136: 8 total, 8 up, 8 in 2024-04-06T03:37:40.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: 168.1 deep-scrub starts 2024-04-06T03:37:40.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: 168.1 deep-scrub ok 2024-04-06T03:37:40.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: 168.0 scrub starts 2024-04-06T03:37:40.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: 168.0 scrub ok 2024-04-06T03:37:40.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: pgmap v159: 460 pgs: 96 unknown, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 74 KiB/s wr, 73 op/s 2024-04-06T03:37:40.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: 168.7 scrub starts 2024-04-06T03:37:40.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: 168.7 scrub ok 2024-04-06T03:37:40.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:40.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:40.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:39 smithi047 ceph-mon[37680]: osdmap e136: 8 total, 8 up, 8 in 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: 168.9 scrub starts 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: 168.9 scrub ok 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: 168.5 scrub starts 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: 168.5 scrub ok 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: osdmap e137: 8 total, 8 up, 8 in 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3582617187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4263932104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi047-74473-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: 168.9 scrub starts 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: 168.9 scrub ok 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: 168.5 scrub starts 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: 168.5 scrub ok 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: osdmap e137: 8 total, 8 up, 8 in 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3582617187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4263932104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi047-74473-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: 168.9 scrub starts 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: 168.9 scrub ok 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: 168.5 scrub starts 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: 168.5 scrub ok 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: osdmap e137: 8 total, 8 up, 8 in 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3582617187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4263932104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi047-74473-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:41.824 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:41 smithi102 ceph-mon[32821]: pgmap v162: 396 pgs: 32 unknown, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 KiB/s wr, 10 op/s 2024-04-06T03:37:42.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:37:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:37:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4263932104' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi047-74473-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:41 smithi102 ceph-mon[32821]: osdmap e138: 8 total, 8 up, 8 in 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[29365]: pgmap v162: 396 pgs: 32 unknown, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 KiB/s wr, 10 op/s 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4263932104' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi047-74473-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[29365]: osdmap e138: 8 total, 8 up, 8 in 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[37680]: pgmap v162: 396 pgs: 32 unknown, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 KiB/s wr, 10 op/s 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi047-74496-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4263932104' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi047-74473-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:41 smithi047 ceph-mon[37680]: osdmap e138: 8 total, 8 up, 8 in 2024-04-06T03:37:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:42 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:42 smithi102 ceph-mon[32821]: osdmap e139: 8 total, 8 up, 8 in 2024-04-06T03:37:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/110925785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:43.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:43.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:43.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[29365]: osdmap e139: 8 total, 8 up, 8 in 2024-04-06T03:37:43.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/110925785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:43.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:43.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:43.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:43.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[37680]: osdmap e139: 8 total, 8 up, 8 in 2024-04-06T03:37:43.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/110925785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:43.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: pgmap v165: 396 pgs: 64 creating+peering, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 60 KiB/s rd, 74 op/s 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: osdmap e140: 8 total, 8 up, 8 in 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/907423691' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2478092381' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi047-74496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2"}]: dispatch 2024-04-06T03:37:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:44.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:37:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:37:44.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: pgmap v165: 396 pgs: 64 creating+peering, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 60 KiB/s rd, 74 op/s 2024-04-06T03:37:44.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:44.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-06T03:37:44.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: osdmap e140: 8 total, 8 up, 8 in 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/907423691' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2478092381' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi047-74496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2"}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: pgmap v165: 396 pgs: 64 creating+peering, 332 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 60 KiB/s rd, 74 op/s 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74786-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: osdmap e140: 8 total, 8 up, 8 in 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/907423691' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2478092381' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi047-74496-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2"}]: dispatch 2024-04-06T03:37:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:44.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:44.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:44.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2478092381' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi047-74496-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: osdmap e141: 8 total, 8 up, 8 in 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2478092381' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi047-74496-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: osdmap e141: 8 total, 8 up, 8 in 2024-04-06T03:37:45.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:45.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:45.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2478092381' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi047-74496-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi047-74473-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi047-74693-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: osdmap e141: 8 total, 8 up, 8 in 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/258480947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]: dispatch 2024-04-06T03:37:45.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-06T03:37:45.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: Running main() from gmock_main.cc 2024-04-06T03:37:45.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-04-06T03:37:45.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] Global test environment set-up. 2024-04-06T03:37:45.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-04-06T03:37:45.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (5217 ms) 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (1596 ms) 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (3009 ms) 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2616 ms) 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (12438 ms total) 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-04-06T03:37:45.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (5987 ms) 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (6503 ms) 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5254 ms) 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (17744 ms total) 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2724 ms) 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2007 ms) 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1900 ms) 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-04-06T03:37:45.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2052 ms) 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8683 ms total) 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4027 ms) 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4011 ms) 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8038 ms total) 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [----------] Global test environment tear-down 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (75059 ms total) 2024-04-06T03:37:45.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-04-06T03:37:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[29365]: pgmap v168: 452 pgs: 128 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 56 KiB/s rd, 73 op/s 2024-04-06T03:37:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[29365]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[29365]: osdmap e142: 8 total, 8 up, 8 in 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[37680]: pgmap v168: 452 pgs: 128 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 56 KiB/s rd, 73 op/s 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[37680]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[37680]: osdmap e142: 8 total, 8 up, 8 in 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:37:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:37:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:46 smithi102 ceph-mon[32821]: pgmap v168: 452 pgs: 128 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 56 KiB/s rd, 73 op/s 2024-04-06T03:37:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:46 smithi102 ceph-mon[32821]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi047-74795-15"}]': finished 2024-04-06T03:37:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-06T03:37:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:46 smithi102 ceph-mon[32821]: osdmap e142: 8 total, 8 up, 8 in 2024-04-06T03:37:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:37:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-06T03:37:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: pgmap v171: 356 pgs: 5 unknown, 351 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1 op/s 2024-04-06T03:37:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-06T03:37:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: osdmap e143: 8 total, 8 up, 8 in 2024-04-06T03:37:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4232183204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4191204509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: pgmap v171: 356 pgs: 5 unknown, 351 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1 op/s 2024-04-06T03:37:47.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: osdmap e143: 8 total, 8 up, 8 in 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4232183204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4191204509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:47.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: pgmap v171: 356 pgs: 5 unknown, 351 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1 op/s 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: osdmap e143: 8 total, 8 up, 8 in 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/724187458' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4232183204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4191204509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]: dispatch 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:48.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:48.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4191204509' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]': finished 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: osdmap e144: 8 total, 8 up, 8 in 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi047-74786-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4191204509' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]': finished 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: osdmap e144: 8 total, 8 up, 8 in 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi047-74786-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:49.061 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-04-06T03:37:49.061 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-04-06T03:37:49.061 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-04-06T03:37:49.061 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-04-06T03:37:49.061 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-04-06T03:37:49.061 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: seed 74693 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (3 ms) 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (1188 ms) 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (6 ms) 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (6 ms) 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (6 ms) 2024-04-06T03:37:49.062 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (2 ms) 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (1 ms) 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (3 ms) 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (1 ms) 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (6 ms) 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (1 ms) 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (4 ms) 2024-04-06T03:37:49.063 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (4 ms) 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: osd_max_attr_size = 0 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1715 ms) 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (346 ms) 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: done waiting, doing copies 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: waiting for final deep scrubs... 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: done waiting 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (61003 ms) 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (5 ms) 2024-04-06T03:37:49.064 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (2 ms) 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4501 ms) 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-04-06T03:37:49.065 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-04-06T03:37:49.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:37:49.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:37:49.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4191204509' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74473-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi047-74693-1","app":"app1","key":"key1"}]': finished 2024-04-06T03:37:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: osdmap e144: 8 total, 8 up, 8 in 2024-04-06T03:37:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi047-74786-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:37:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: pgmap v174: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: osdmap e145: 8 total, 8 up, 8 in 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: pgmap v174: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:37:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: osdmap e145: 8 total, 8 up, 8 in 2024-04-06T03:37:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: pgmap v174: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: osdmap e145: 8 total, 8 up, 8 in 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi047-74786-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: osdmap e146: 8 total, 8 up, 8 in 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1409778940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1340132620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:51.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:50 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi047-74786-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: osdmap e146: 8 total, 8 up, 8 in 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1409778940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1340132620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi047-74786-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74693-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: osdmap e146: 8 total, 8 up, 8 in 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1409778940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1340132620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:51.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:50 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:52.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:37:51 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:37:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:51 smithi102 ceph-mon[32821]: pgmap v177: 396 pgs: 104 unknown, 292 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:51 smithi102 ceph-mon[32821]: osdmap e147: 8 total, 8 up, 8 in 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[37680]: pgmap v177: 396 pgs: 104 unknown, 292 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[37680]: osdmap e147: 8 total, 8 up, 8 in 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[29365]: pgmap v177: 396 pgs: 104 unknown, 292 active+clean; 592 KiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi047-74473-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi047-74496-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:52.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:51 smithi047 ceph-mon[29365]: osdmap e147: 8 total, 8 up, 8 in 2024-04-06T03:37:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:52 smithi102 ceph-mon[32821]: osdmap e148: 8 total, 8 up, 8 in 2024-04-06T03:37:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:52 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:52 smithi047 ceph-mon[29365]: osdmap e148: 8 total, 8 up, 8 in 2024-04-06T03:37:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:52 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74693-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:52 smithi047 ceph-mon[37680]: osdmap e148: 8 total, 8 up, 8 in 2024-04-06T03:37:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:52 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:37:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: pgmap v180: 340 pgs: 8 unknown, 332 active+clean; 592 KiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:37:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: osdmap e149: 8 total, 8 up, 8 in 2024-04-06T03:37:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3448223774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4109048170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:54.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:37:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:37:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: pgmap v180: 340 pgs: 8 unknown, 332 active+clean; 592 KiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:37:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: osdmap e149: 8 total, 8 up, 8 in 2024-04-06T03:37:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3448223774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4109048170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: pgmap v180: 340 pgs: 8 unknown, 332 active+clean; 592 KiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: osdmap e149: 8 total, 8 up, 8 in 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3448223774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4109048170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:54.850 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP (6 api_snapshots_pp: Running main() from gmock_main.cc 2024-04-06T03:37:54.850 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-04-06T03:37:54.850 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-04-06T03:37:54.850 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-04-06T03:37:54.850 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: seed 74786 2024-04-06T03:37:54.850 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-04-06T03:37:54.850 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5219 ms) 2024-04-06T03:37:54.850 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (1600 ms) 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (3001 ms) 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2619 ms) 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (5042 ms) 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (17481 ms total) 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (5517 ms) 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-06T03:37:54.851 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (5161 ms) 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6016 ms) 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3832 ms) 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2190 ms) 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2027-g9f192350/rpm/el9/BUILD/ceph-19.0.0-2027-g9f192350/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi047-74786-7 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: waiting for snaps to purge 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17816 ms) 2024-04-06T03:37:54.852 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (40532 ms total) 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (9 ms) 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5039 ms) 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5048 ms total) 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3016 ms) 2024-04-06T03:37:54.853 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-06T03:37:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[29365]: osdmap e150: 8 total, 8 up, 8 in 2024-04-06T03:37:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[37680]: osdmap e150: 8 total, 8 up, 8 in 2024-04-06T03:37:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:55.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi047-74496-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi047-74473-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:54 smithi102 ceph-mon[32821]: osdmap e150: 8 total, 8 up, 8 in 2024-04-06T03:37:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: pgmap v183: 436 pgs: 104 unknown, 332 active+clean; 592 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:37:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: osdmap e151: 8 total, 8 up, 8 in 2024-04-06T03:37:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: osdmap e152: 8 total, 8 up, 8 in 2024-04-06T03:37:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4201294408' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi047-74496-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/492313009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: pgmap v183: 436 pgs: 104 unknown, 332 active+clean; 592 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: osdmap e151: 8 total, 8 up, 8 in 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: osdmap e152: 8 total, 8 up, 8 in 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4201294408' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi047-74496-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/492313009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:56.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: pgmap v183: 436 pgs: 104 unknown, 332 active+clean; 592 KiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:37:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74693-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: osdmap e151: 8 total, 8 up, 8 in 2024-04-06T03:37:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:37:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: osdmap e152: 8 total, 8 up, 8 in 2024-04-06T03:37:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4201294408' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi047-74496-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/492313009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:57.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4201294408' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi047-74496-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[29365]: osdmap e153: 8 total, 8 up, 8 in 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4201294408' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi047-74496-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:57.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[37680]: osdmap e153: 8 total, 8 up, 8 in 2024-04-06T03:37:57.147 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:57.147 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:57.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:57.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4201294408' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi047-74496-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:57.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi047-74473-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:37:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:56 smithi102 ceph-mon[32821]: osdmap e153: 8 total, 8 up, 8 in 2024-04-06T03:37:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:58 smithi102 ceph-mon[32821]: pgmap v186: 404 pgs: 59 creating+peering, 5 unknown, 340 active+clean; 592 KiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:37:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:58 smithi102 ceph-mon[32821]: osdmap e154: 8 total, 8 up, 8 in 2024-04-06T03:37:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[29365]: pgmap v186: 404 pgs: 59 creating+peering, 5 unknown, 340 active+clean; 592 KiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:37:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[29365]: osdmap e154: 8 total, 8 up, 8 in 2024-04-06T03:37:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:58.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[37680]: pgmap v186: 404 pgs: 59 creating+peering, 5 unknown, 340 active+clean; 592 KiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:37:58.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:58.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:58.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[37680]: osdmap e154: 8 total, 8 up, 8 in 2024-04-06T03:37:58.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2723654175' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:58.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]: dispatch 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: pgmap v189: 332 pgs: 332 active+clean; 592 KiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: osdmap e155: 8 total, 8 up, 8 in 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1193182093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3605978997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:37:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:59.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:59.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: pgmap v189: 332 pgs: 332 active+clean; 592 KiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:37:59.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:59.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: osdmap e155: 8 total, 8 up, 8 in 2024-04-06T03:37:59.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1193182093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3605978997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: pgmap v189: 332 pgs: 332 active+clean; 592 KiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74693-24"}]': finished 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: osdmap e155: 8 total, 8 up, 8 in 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1193182093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3605978997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:37:59.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:37:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: osdmap e156: 8 total, 8 up, 8 in 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/730635451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi047-74693-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:00 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: osdmap e156: 8 total, 8 up, 8 in 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/730635451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi047-74693-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi047-74473-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi047-74496-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: osdmap e156: 8 total, 8 up, 8 in 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/730635451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi047-74693-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:00 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:02.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:38:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:38:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:01 smithi102 ceph-mon[32821]: pgmap v192: 420 pgs: 96 unknown, 324 active+clean; 592 KiB data, 600 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/730635451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi047-74693-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:38:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]': finished 2024-04-06T03:38:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:01 smithi102 ceph-mon[32821]: osdmap e157: 8 total, 8 up, 8 in 2024-04-06T03:38:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:38:02.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[37680]: pgmap v192: 420 pgs: 96 unknown, 324 active+clean; 592 KiB data, 600 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:02.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/730635451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi047-74693-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:02.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:38:02.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]': finished 2024-04-06T03:38:02.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:02.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[37680]: osdmap e157: 8 total, 8 up, 8 in 2024-04-06T03:38:02.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:38:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[29365]: pgmap v192: 420 pgs: 96 unknown, 324 active+clean; 592 KiB data, 600 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/730635451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi047-74693-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:38:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]': finished 2024-04-06T03:38:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[29365]: osdmap e157: 8 total, 8 up, 8 in 2024-04-06T03:38:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]: dispatch 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: osdmap e158: 8 total, 8 up, 8 in 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1279806557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2018935351' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1279806557' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74496-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: osdmap e159: 8 total, 8 up, 8 in 2024-04-06T03:38:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:03.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:38:03.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: osdmap e158: 8 total, 8 up, 8 in 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1279806557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2018935351' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1279806557' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74496-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: osdmap e159: 8 total, 8 up, 8 in 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/848686748' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi047-74786-16"}]': finished 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: osdmap e158: 8 total, 8 up, 8 in 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1279806557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74496-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2018935351' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1279806557' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi047-74496-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi047-74473-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: osdmap e159: 8 total, 8 up, 8 in 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:04.056 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:38:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:38:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:38:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:04 smithi102 ceph-mon[32821]: pgmap v195: 388 pgs: 64 unknown, 324 active+clean; 592 KiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:38:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/156692206' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi047-74693-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/156692206' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi047-74693-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:04.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:04 smithi047 ceph-mon[29365]: pgmap v195: 388 pgs: 64 unknown, 324 active+clean; 592 KiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:38:04.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/156692206' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi047-74693-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:04.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/156692206' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi047-74693-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:04.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:04 smithi047 ceph-mon[37680]: pgmap v195: 388 pgs: 64 unknown, 324 active+clean; 592 KiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:38:04.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/156692206' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi047-74693-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:04.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/156692206' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi047-74693-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: osdmap e160: 8 total, 8 up, 8 in 2024-04-06T03:38:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: osdmap e161: 8 total, 8 up, 8 in 2024-04-06T03:38:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/138125427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3607777093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: osdmap e160: 8 total, 8 up, 8 in 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: osdmap e161: 8 total, 8 up, 8 in 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/138125427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3607777093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: osdmap e160: 8 total, 8 up, 8 in 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: osdmap e161: 8 total, 8 up, 8 in 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/138125427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3607777093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:05.811 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnaps snapshots: Running main() from gmock_main.cc 2024-04-06T03:38:05.811 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [----------] Global test environment set-up. 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (17190 ms) 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (6872 ms) 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4777 ms) 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (7752 ms) 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (8129 ms) 2024-04-06T03:38:05.812 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (44720 ms total) 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (5993 ms) 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6007 ms) 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (7991 ms) 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6017 ms) 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-04-06T03:38:05.813 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4010 ms) 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi047-75780-11. 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: Waiting for snaps to purge. 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20005 ms) 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (50024 ms total) 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [----------] Global test environment tear-down 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (94744 ms total) 2024-04-06T03:38:05.814 INFO:tasks.workunit.client.0.smithi047.stdout: snapshots: [ PASSED ] 11 tests. 2024-04-06T03:38:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[29365]: pgmap v198: 356 pgs: 32 unknown, 324 active+clean; 592 KiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[29365]: osdmap e162: 8 total, 8 up, 8 in 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/178765333' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[37680]: pgmap v198: 356 pgs: 32 unknown, 324 active+clean; 592 KiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[37680]: osdmap e162: 8 total, 8 up, 8 in 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/178765333' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:06.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:06.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:06 smithi102 ceph-mon[32821]: pgmap v198: 356 pgs: 32 unknown, 324 active+clean; 592 KiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:06 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi047-74496-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi047-74473-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:06 smithi102 ceph-mon[32821]: osdmap e162: 8 total, 8 up, 8 in 2024-04-06T03:38:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/178765333' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:08.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: pgmap v201: 396 pgs: 28 creating+peering, 13 unknown, 355 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: osdmap e163: 8 total, 8 up, 8 in 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: pgmap v201: 396 pgs: 28 creating+peering, 13 unknown, 355 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: osdmap e163: 8 total, 8 up, 8 in 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: pgmap v201: 396 pgs: 28 creating+peering, 13 unknown, 355 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi047-74693-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: osdmap e163: 8 total, 8 up, 8 in 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: osdmap e164: 8 total, 8 up, 8 in 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3584626247' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi047-74496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:38:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:38:09.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:38:09.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3584626247' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi047-74496-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: osdmap e164: 8 total, 8 up, 8 in 2024-04-06T03:38:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3584626247' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi047-74496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3584626247' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi047-74496-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi047-74473-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: osdmap e164: 8 total, 8 up, 8 in 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3584626247' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi047-74496-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:38:09.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3584626247' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi047-74496-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:10 smithi102 ceph-mon[32821]: pgmap v204: 332 pgs: 32 unknown, 300 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:10 smithi102 ceph-mon[32821]: osdmap e165: 8 total, 8 up, 8 in 2024-04-06T03:38:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi047-74693-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:10 smithi102 ceph-mon[32821]: osdmap e166: 8 total, 8 up, 8 in 2024-04-06T03:38:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[37680]: pgmap v204: 332 pgs: 32 unknown, 300 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[37680]: osdmap e165: 8 total, 8 up, 8 in 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi047-74693-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[37680]: osdmap e166: 8 total, 8 up, 8 in 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[29365]: pgmap v204: 332 pgs: 32 unknown, 300 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[29365]: osdmap e165: 8 total, 8 up, 8 in 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi047-74693-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi047-74473-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:10.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:10 smithi047 ceph-mon[29365]: osdmap e166: 8 total, 8 up, 8 in 2024-04-06T03:38:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi047-74693-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-mon[32821]: osdmap e167: 8 total, 8 up, 8 in 2024-04-06T03:38:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2456387053' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi047-74693-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[37680]: osdmap e167: 8 total, 8 up, 8 in 2024-04-06T03:38:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2456387053' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi047-74693-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[29365]: osdmap e167: 8 total, 8 up, 8 in 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2456387053' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:12.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:38:11 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:38:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: pgmap v207: 308 pgs: 8 unknown, 300 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: osdmap e168: 8 total, 8 up, 8 in 2024-04-06T03:38:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:38:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:38:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: pgmap v207: 308 pgs: 8 unknown, 300 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: osdmap e168: 8 total, 8 up, 8 in 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: pgmap v207: 308 pgs: 8 unknown, 300 active+clean; 600 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi047-74496-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: osdmap e168: 8 total, 8 up, 8 in 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:38:12.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:12.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:12.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]: dispatch 2024-04-06T03:38:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]': finished 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: osdmap e169: 8 total, 8 up, 8 in 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]': finished 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: osdmap e169: 8 total, 8 up, 8 in 2024-04-06T03:38:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-13"}]': finished 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3995535917' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: osdmap e169: 8 total, 8 up, 8 in 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]: dispatch 2024-04-06T03:38:13.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:13.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: Running main() from gmock_main.cc 2024-04-06T03:38:13.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-04-06T03:38:13.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [----------] Global test environment set-up. 2024-04-06T03:38:13.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-04-06T03:38:13.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.TooBig (10456 ms) 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (7176 ms) 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (4227 ms) 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3967 ms) 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3450 ms) 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3581 ms) 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-04-06T03:38:13.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3163 ms) 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3259 ms) 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (5166 ms) 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (4212 ms) 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2492 ms) 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3106 ms) 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2900 ms) 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-04-06T03:38:13.835 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2995 ms) 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.Flush (3265 ms) 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2742 ms) 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3004 ms) 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3012 ms) 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3013 ms) 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3255 ms) 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-04-06T03:38:13.836 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (2769 ms) 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3025 ms) 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2926 ms) 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3015 ms) 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3260 ms) 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2752 ms) 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [----------] 26 tests from LibRadosAio (96188 ms total) 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-04-06T03:38:13.837 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2024-04-06T03:38:14.112 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:38:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:38:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:38:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: pgmap v210: 340 pgs: 40 creating+peering, 300 active+clean; 609 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 24 op/s 2024-04-06T03:38:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: osdmap e170: 8 total, 8 up, 8 in 2024-04-06T03:38:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/999014146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi047-74496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi047-74473-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: pgmap v210: 340 pgs: 40 creating+peering, 300 active+clean; 609 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 24 op/s 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: osdmap e170: 8 total, 8 up, 8 in 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/999014146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi047-74496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:14.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:14.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:14.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi047-74473-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: pgmap v210: 340 pgs: 40 creating+peering, 300 active+clean; 609 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 24 op/s 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi047-74473-27"}]': finished 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: osdmap e170: 8 total, 8 up, 8 in 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]: dispatch 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/999014146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi047-74496-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi047-74473-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:14.831 INFO:tasks.workunit.client.0.smithi047.stdout:8804 ms total) 2024-04-06T03:38:14.831 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: 2024-04-06T03:38:14.831 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (122 ms) 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (122 ms total) 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (46 ms) 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (3 ms) 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (49 ms total) 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-04-06T03:38:14.832 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (16 ms) 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (3 ms) 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (19 ms total) 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (50 ms) 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (5 ms) 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (55 ms total) 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-04-06T03:38:14.833 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-04-06T03:38:14.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1031 ms) 2024-04-06T03:38:14.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1031 ms total) 2024-04-06T03:38:14.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: 2024-04-06T03:38:14.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-04-06T03:38:14.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (104093 ms total) 2024-04-06T03:38:14.834 INFO:tasks.workunit.client.0.smithi047.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-04-06T03:38:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: pgmap v213: 300 pgs: 32 unknown, 268 active+clean; 609 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-04-06T03:38:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/999014146' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi047-74496-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi047-74473-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:16.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: osdmap e171: 8 total, 8 up, 8 in 2024-04-06T03:38:16.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi047-74473-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:16.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:16.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:16.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: pgmap v213: 300 pgs: 32 unknown, 268 active+clean; 609 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-04-06T03:38:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/999014146' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi047-74496-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi047-74473-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: osdmap e171: 8 total, 8 up, 8 in 2024-04-06T03:38:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi047-74473-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: pgmap v213: 300 pgs: 32 unknown, 268 active+clean; 609 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1989022137' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi047-74693-36"}]': finished 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/999014146' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi047-74496-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi047-74473-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: osdmap e171: 8 total, 8 up, 8 in 2024-04-06T03:38:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi047-74473-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:16.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:16.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:16.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:17 smithi102 ceph-mon[32821]: osdmap e172: 8 total, 8 up, 8 in 2024-04-06T03:38:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi047-74473-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:17 smithi102 ceph-mon[32821]: osdmap e173: 8 total, 8 up, 8 in 2024-04-06T03:38:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1252172567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi047-74496-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[29365]: osdmap e172: 8 total, 8 up, 8 in 2024-04-06T03:38:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi047-74473-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:17.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[29365]: osdmap e173: 8 total, 8 up, 8 in 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1252172567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi047-74496-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[37680]: osdmap e172: 8 total, 8 up, 8 in 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi047-74473-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[37680]: osdmap e173: 8 total, 8 up, 8 in 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1252172567' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi047-74496-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:17.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: pgmap v216: 300 pgs: 7 unknown, 293 active+clean; 609 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:38:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1252172567' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi047-74496-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: osdmap e174: 8 total, 8 up, 8 in 2024-04-06T03:38:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:18.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: pgmap v216: 300 pgs: 7 unknown, 293 active+clean; 609 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:38:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1252172567' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi047-74496-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: osdmap e174: 8 total, 8 up, 8 in 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: pgmap v216: 300 pgs: 7 unknown, 293 active+clean; 609 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1252172567' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi047-74496-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: osdmap e174: 8 total, 8 up, 8 in 2024-04-06T03:38:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:19.802 INFO:tasks.workunit.client.0.smithi047.stdout:hotsECPP.SnapRemovePP (2016 ms) 2024-04-06T03:38:19.802 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-04-06T03:38:19.802 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (1933 ms) 2024-04-06T03:38:19.802 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-06T03:38:19.802 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2000 ms) 2024-04-06T03:38:19.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8965 ms total) 2024-04-06T03:38:19.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: 2024-04-06T03:38:19.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4258 ms) 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3739 ms) 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3971 ms) 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11968 ms total) 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (109059 ms total) 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-04-06T03:38:19.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-06T03:38:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: pgmap v219: 332 pgs: 40 unknown, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]': finished 2024-04-06T03:38:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: osdmap e175: 8 total, 8 up, 8 in 2024-04-06T03:38:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]: dispatch 2024-04-06T03:38:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]: dispatch 2024-04-06T03:38:20.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: pgmap v219: 332 pgs: 40 unknown, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]': finished 2024-04-06T03:38:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: osdmap e175: 8 total, 8 up, 8 in 2024-04-06T03:38:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]: dispatch 2024-04-06T03:38:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]: dispatch 2024-04-06T03:38:20.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: pgmap v219: 332 pgs: 40 unknown, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-15"}]': finished 2024-04-06T03:38:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: osdmap e175: 8 total, 8 up, 8 in 2024-04-06T03:38:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]: dispatch 2024-04-06T03:38:20.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]: dispatch 2024-04-06T03:38:20.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:20.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]: dispatch 2024-04-06T03:38:20.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:21.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:21.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:21.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:21.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]': finished 2024-04-06T03:38:21.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: osdmap e176: 8 total, 8 up, 8 in 2024-04-06T03:38:21.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2112609355' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:21.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:21.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:21.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:21.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]': finished 2024-04-06T03:38:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: osdmap e176: 8 total, 8 up, 8 in 2024-04-06T03:38:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2112609355' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3169166052' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi047-74786-21"}]': finished 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-15", "mode": "writeback"}]': finished 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: osdmap e176: 8 total, 8 up, 8 in 2024-04-06T03:38:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2112609355' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]: dispatch 2024-04-06T03:38:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1714263254' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi047-74473-28"}]': finished 2024-04-06T03:38:22.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:38:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: pgmap v222: 324 pgs: 32 unknown, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: osdmap e177: 8 total, 8 up, 8 in 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: osdmap e178: 8 total, 8 up, 8 in 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:22.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: pgmap v222: 324 pgs: 32 unknown, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:22.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:22.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: osdmap e177: 8 total, 8 up, 8 in 2024-04-06T03:38:22.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:22.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: osdmap e178: 8 total, 8 up, 8 in 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: pgmap v222: 324 pgs: 32 unknown, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi047-74496-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: osdmap e177: 8 total, 8 up, 8 in 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:22.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi047-74473-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:22.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:22.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: osdmap e178: 8 total, 8 up, 8 in 2024-04-06T03:38:22.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:22.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:22.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]: dispatch 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]': finished 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: osdmap e179: 8 total, 8 up, 8 in 2024-04-06T03:38:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1862292390' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi047-74496-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-04-06T03:38:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]': finished 2024-04-06T03:38:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: osdmap e179: 8 total, 8 up, 8 in 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1862292390' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi047-74496-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-15"}]': finished 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: osdmap e179: 8 total, 8 up, 8 in 2024-04-06T03:38:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1862292390' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi047-74496-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:24.075 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:38:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:38:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: pgmap v225: 292 pgs: 292 active+clean; 585 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1862292390' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi047-74496-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: osdmap e180: 8 total, 8 up, 8 in 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: pgmap v225: 292 pgs: 292 active+clean; 585 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1862292390' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi047-74496-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: osdmap e180: 8 total, 8 up, 8 in 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: pgmap v225: 292 pgs: 292 active+clean; 585 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi047-74473-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1862292390' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi047-74496-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: osdmap e180: 8 total, 8 up, 8 in 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:24.804 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (10443 ms) 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (22392 ms) 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (8501 ms) 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3130 ms) 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (4189 ms) 2024-04-06T03:38:24.805 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2487 ms) 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3102 ms) 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2903 ms) 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3003 ms) 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3259 ms) 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2741 ms) 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3010 ms) 2024-04-06T03:38:24.806 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3001 ms) 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3010 ms) 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3263 ms) 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2769 ms) 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3024 ms) 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2931 ms) 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3008 ms) 2024-04-06T03:38:24.807 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3276 ms) 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2740 ms) 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3268 ms) 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2742 ms) 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3223 ms) 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2749 ms) 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3005 ms) 2024-04-06T03:38:24.808 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: pgmap v228: 300 pgs: 40 unknown, 260 active+clean; 585 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]': finished 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: osdmap e181: 8 total, 8 up, 8 in 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]': finished 2024-04-06T03:38:26.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: osdmap e182: 8 total, 8 up, 8 in 2024-04-06T03:38:26.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2437408768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:26.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: pgmap v228: 300 pgs: 40 unknown, 260 active+clean; 585 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]': finished 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: osdmap e181: 8 total, 8 up, 8 in 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]': finished 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: osdmap e182: 8 total, 8 up, 8 in 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2437408768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: pgmap v228: 300 pgs: 40 unknown, 260 active+clean; 585 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]': finished 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: osdmap e181: 8 total, 8 up, 8 in 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]: dispatch 2024-04-06T03:38:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:26.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pg_num","val":"11"}]': finished 2024-04-06T03:38:26.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: osdmap e182: 8 total, 8 up, 8 in 2024-04-06T03:38:26.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:26.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2437408768' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:26.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:26.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:27.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:27.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:27.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-04-06T03:38:27.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:27.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:27.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:27.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-04-06T03:38:27.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: osdmap e183: 8 total, 8 up, 8 in 2024-04-06T03:38:27.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:27.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:27.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:27.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:27.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:27.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:27.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:27.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-04-06T03:38:27.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:27.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: osdmap e183: 8 total, 8 up, 8 in 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:27.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi047-74496-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: osdmap e183: 8 total, 8 up, 8 in 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1802669550' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]: dispatch 2024-04-06T03:38:27.150 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:28.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:27 smithi102 ceph-mon[32821]: pgmap v231: 324 pgs: 30 creating+peering, 7 unknown, 287 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 31 B/s, 0 objects/s recovering 2024-04-06T03:38:28.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:28.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]': finished 2024-04-06T03:38:28.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:27 smithi102 ceph-mon[32821]: osdmap e184: 8 total, 8 up, 8 in 2024-04-06T03:38:28.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:28.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]: dispatch 2024-04-06T03:38:28.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]: dispatch 2024-04-06T03:38:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[37680]: pgmap v231: 324 pgs: 30 creating+peering, 7 unknown, 287 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 31 B/s, 0 objects/s recovering 2024-04-06T03:38:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]': finished 2024-04-06T03:38:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[37680]: osdmap e184: 8 total, 8 up, 8 in 2024-04-06T03:38:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]: dispatch 2024-04-06T03:38:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]: dispatch 2024-04-06T03:38:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[29365]: pgmap v231: 324 pgs: 30 creating+peering, 7 unknown, 287 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 31 B/s, 0 objects/s recovering 2024-04-06T03:38:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi047-74473-29"}]': finished 2024-04-06T03:38:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-17"}]': finished 2024-04-06T03:38:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[29365]: osdmap e184: 8 total, 8 up, 8 in 2024-04-06T03:38:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]: dispatch 2024-04-06T03:38:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]: dispatch 2024-04-06T03:38:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:29.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]': finished 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: osdmap e185: 8 total, 8 up, 8 in 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2474577133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:29.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]': finished 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: osdmap e185: 8 total, 8 up, 8 in 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2474577133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-17", "mode": "writeback"}]': finished 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi047-74473-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi047-74590-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-04-06T03:38:29.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: osdmap e185: 8 total, 8 up, 8 in 2024-04-06T03:38:29.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:29.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:29.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2474577133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:29.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:30 smithi102 ceph-mon[32821]: pgmap v234: 292 pgs: 292 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-06T03:38:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:30 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:30.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[29365]: pgmap v234: 292 pgs: 292 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-06T03:38:30.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:30.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:30.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:30.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:30.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[37680]: pgmap v234: 292 pgs: 292 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-06T03:38:30.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:30.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:30.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:30.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi047-74496-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: osdmap e186: 8 total, 8 up, 8 in 2024-04-06T03:38:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]': finished 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]': finished 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: osdmap e187: 8 total, 8 up, 8 in 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: osdmap e186: 8 total, 8 up, 8 in 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]': finished 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]': finished 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: osdmap e187: 8 total, 8 up, 8 in 2024-04-06T03:38:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: osdmap e186: 8 total, 8 up, 8 in 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]: dispatch 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi047-74473-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:31.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi047-74590-1","var":"pgp_num","val":"11"}]': finished 2024-04-06T03:38:31.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-17"}]': finished 2024-04-06T03:38:31.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: osdmap e187: 8 total, 8 up, 8 in 2024-04-06T03:38:31.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2207950162' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-06T03:38:32.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:38:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:38:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:32 smithi102 ceph-mon[32821]: pgmap v237: 323 pgs: 32 unknown, 291 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:32 smithi102 ceph-mon[32821]: osdmap e188: 8 total, 8 up, 8 in 2024-04-06T03:38:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1035838751' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi047-74590-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[37680]: pgmap v237: 323 pgs: 32 unknown, 291 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[37680]: osdmap e188: 8 total, 8 up, 8 in 2024-04-06T03:38:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1035838751' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi047-74590-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[29365]: pgmap v237: 323 pgs: 32 unknown, 291 active+clean; 585 KiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[29365]: osdmap e188: 8 total, 8 up, 8 in 2024-04-06T03:38:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1035838751' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi047-74590-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:33.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:33.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:33.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:33.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi047-74590-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:33.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: osdmap e189: 8 total, 8 up, 8 in 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi047-74590-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi047-74590-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: osdmap e189: 8 total, 8 up, 8 in 2024-04-06T03:38:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi047-74590-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi047-74496-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi047-74590-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: osdmap e189: 8 total, 8 up, 8 in 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi047-74590-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:34.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:38:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:38:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:38:34.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[29365]: pgmap v240: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:34.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:34.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:34.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:34.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:34.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[29365]: osdmap e190: 8 total, 8 up, 8 in 2024-04-06T03:38:34.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:34.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:34.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[37680]: pgmap v240: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:34.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:34.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:34.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:34.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:34.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[37680]: osdmap e190: 8 total, 8 up, 8 in 2024-04-06T03:38:34.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:34.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:34.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:34 smithi102 ceph-mon[32821]: pgmap v240: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:34.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:34.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:34.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/963160191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:34.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:34.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:34 smithi102 ceph-mon[32821]: osdmap e190: 8 total, 8 up, 8 in 2024-04-06T03:38:34.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]: dispatch 2024-04-06T03:38:34.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:35.879 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAitry=10 expected=10 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:c4fdafeb:::6:head 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:c4fdafeb:::6:head expected=16:c4fdafeb:::6:head 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:c4fdafeb:::6:head -> 6 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=6 expected=6 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:bd63b0f1:::8:head 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:bd63b0f1:::8:head expected=16:bd63b0f1:::8:head 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:bd63b0f1:::8:head -> 8 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=8 expected=8 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:b29083e3:::5:head 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:b29083e3:::5:head expected=16:b29083e3:::5:head 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:b29083e3:::5:head -> 5 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=5 expected=5 2024-04-06T03:38:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:89d3ae78:::11:head 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:89d3ae78:::11:head expected=16:89d3ae78:::11:head 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:89d3ae78:::11:head -> 11 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=11 expected=11 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:863748b0:::15:head 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:863748b0:::15:head expected=16:863748b0:::15:head 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:863748b0:::15:head -> 15 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=15 expected=15 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:5c6b0b28:::7:head 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:5c6b0b28:::7:head expected=16:5c6b0b28:::7:head 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:5c6b0b28:::7:head -> 7 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=7 expected=7 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:566253c9:::13:head 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:566253c9:::13:head expected=16:566253c9:::13:head 2024-04-06T03:38:35.881 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:566253c9:::13:head -> 13 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=13 expected=13 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : seek to 16:02547ec2:::1:head 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : cursor()=16:02547ec2:::1:head expected=16:02547ec2:::1:head 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: > 16:02547ec2:::1:head -> 1 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: : entry=1 expected=1 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (195 ms) 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (103050 ms) 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: split 0/5 -> MIN 16:33333333::::head 2024-04-06T03:38:35.882 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: split 1/5 -> 16:33333333::::head 16:66666666::::head 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: split 2/5 -> 16:66666666::::head 16:99999999::::head 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: split 3/5 -> 16:99999999::::head 16:cccccccc::::head 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: split 4/5 -> 16:cccccccc::::head MAX 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (5988 ms) 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [----------] 7 tests from LibRadosList (110790 ms total) 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1037 ms) 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: myset foo1,foo2,foo3 2024-04-06T03:38:35.883 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo1 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo2 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo3 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: myset foo1,foo4,foo5 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo4 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo5 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo1 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: myset foo6,foo7 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo7 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: foo6 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns1:foo4 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns1:foo5 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns2:foo7 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns2:foo6 2024-04-06T03:38:35.884 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: ns1:foo1 2024-04-06T03:38:35.885 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: :foo1 2024-04-06T03:38:35.885 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: :foo2 2024-04-06T03:38:35.885 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: :foo3 2024-04-06T03:38:35.885 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (33 ms) 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: pgmap v243: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi047-74590-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: osdmap e191: 8 total, 8 up, 8 in 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3335796054' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi047-74473-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:35 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:36.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: pgmap v243: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:36.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi047-74590-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: osdmap e191: 8 total, 8 up, 8 in 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3335796054' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi047-74473-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:36.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: pgmap v243: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi047-74590-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi047-74473-30"}]': finished 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: osdmap e191: 8 total, 8 up, 8 in 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3335796054' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi047-74473-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:36.262 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:35 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]': finished 2024-04-06T03:38:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi047-74473-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: osdmap e192: 8 total, 8 up, 8 in 2024-04-06T03:38:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]: dispatch 2024-04-06T03:38:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi047-74473-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]: dispatch 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3335796054' entity='client.admin' cmd=[{ 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: "prefix": "osd pool set", 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: "var": "eio", 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: "val": "true" 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: }]: dispatch 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{ 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: "prefix": "osd pool set", 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: "var": "eio", 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: "val": "true" 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: }]: dispatch 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:37.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]': finished 2024-04-06T03:38:37.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]': finished 2024-04-06T03:38:37.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi047-74473-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: osdmap e192: 8 total, 8 up, 8 in 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]: dispatch 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi047-74473-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]: dispatch 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3335796054' entity='client.admin' cmd=[{ 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: "prefix": "osd pool set", 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: "var": "eio", 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: "val": "true" 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: }]: dispatch 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{ 2024-04-06T03:38:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: "prefix": "osd pool set", 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: "var": "eio", 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: "val": "true" 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: }]: dispatch 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]': finished 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-19"}]': finished 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi047-74496-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi047-74473-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: osdmap e192: 8 total, 8 up, 8 in 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]: dispatch 2024-04-06T03:38:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi047-74473-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]: dispatch 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3335796054' entity='client.admin' cmd=[{ 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: "prefix": "osd pool set", 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: "var": "eio", 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: "val": "true" 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: }]: dispatch 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{ 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: "prefix": "osd pool set", 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: "var": "eio", 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: "val": "true" 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: }]: dispatch 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:37.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-19", "mode": "writeback"}]': finished 2024-04-06T03:38:38.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: pgmap v246: 300 pgs: 300 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 20 KiB/s wr, 27 op/s 2024-04-06T03:38:38.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{ 2024-04-06T03:38:38.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: "prefix": "osd pool set", 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: "var": "eio", 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: "val": "true" 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: }]': finished 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: osdmap e193: 8 total, 8 up, 8 in 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi047-74473-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: osdmap e194: 8 total, 8 up, 8 in 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: pgmap v246: 300 pgs: 300 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 20 KiB/s wr, 27 op/s 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{ 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: "prefix": "osd pool set", 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: "var": "eio", 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: "val": "true" 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: }]': finished 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: osdmap e193: 8 total, 8 up, 8 in 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:38.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi047-74473-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:38.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:38.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:38.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: osdmap e194: 8 total, 8 up, 8 in 2024-04-06T03:38:38.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:38.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:38.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: pgmap v246: 300 pgs: 300 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 20 KiB/s wr, 27 op/s 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{ 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: "prefix": "osd pool set", 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: "pool": "PoolEIOFlag_smithi047-74496-33", 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: "var": "eio", 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: "val": "true" 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: }]': finished 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: osdmap e193: 8 total, 8 up, 8 in 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:38.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi047-74473-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:38.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:38.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:38.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: osdmap e194: 8 total, 8 up, 8 in 2024-04-06T03:38:38.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:38.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]: dispatch 2024-04-06T03:38:38.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]: dispatch 2024-04-06T03:38:39.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:39.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]': finished 2024-04-06T03:38:39.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:39.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[29365]: osdmap e195: 8 total, 8 up, 8 in 2024-04-06T03:38:39.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2063413892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:39.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]': finished 2024-04-06T03:38:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[37680]: osdmap e195: 8 total, 8 up, 8 in 2024-04-06T03:38:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2063413892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:39.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:39 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:39.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-19"}]': finished 2024-04-06T03:38:39.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1578193049' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi047-74590-2"}]': finished 2024-04-06T03:38:39.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:39 smithi102 ceph-mon[32821]: osdmap e195: 8 total, 8 up, 8 in 2024-04-06T03:38:39.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2063413892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:39.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[29365]: pgmap v249: 268 pgs: 8 unknown, 260 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[29365]: osdmap e196: 8 total, 8 up, 8 in 2024-04-06T03:38:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1414609403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[37680]: pgmap v249: 268 pgs: 8 unknown, 260 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[37680]: osdmap e196: 8 total, 8 up, 8 in 2024-04-06T03:38:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1414609403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:40.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:40 smithi102 ceph-mon[32821]: pgmap v249: 268 pgs: 8 unknown, 260 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:38:40.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi047-74496-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:40.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:40 smithi102 ceph-mon[32821]: osdmap e196: 8 total, 8 up, 8 in 2024-04-06T03:38:40.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1414609403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:40.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:40.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:41.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:41.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:41.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:41.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: osdmap e197: 8 total, 8 up, 8 in 2024-04-06T03:38:41.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:41.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:41.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1414609403' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: osdmap e197: 8 total, 8 up, 8 in 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1414609403' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-06T03:38:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-06T03:38:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74590-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: osdmap e197: 8 total, 8 up, 8 in 2024-04-06T03:38:41.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:41.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]: dispatch 2024-04-06T03:38:41.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:41.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1414609403' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-06T03:38:41.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 1 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 10 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 13 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 7 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 14 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 0 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 15 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 11 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 5 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 8 0 2024-04-06T03:38:41.829 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 6 0 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 3 0 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 4 0 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 12 0 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 9 0 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 2 0 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (44 ms) 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [----------] 3 tests from LibRadosListEC (1115 ms total) 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3009 ms) 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [----------] 1 test from LibRadosListNP (3009 ms total) 2024-04-06T03:38:41.830 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: 2024-04-06T03:38:41.831 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [----------] Global test environment tear-down 2024-04-06T03:38:41.831 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [==========] 11 tests from 3 test suites ran. (131145 ms total) 2024-04-06T03:38:41.831 INFO:tasks.workunit.client.0.smithi047.stdout: api_list: [ PASSED ] 11 tests. 2024-04-06T03:38:42.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:38:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:38:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: pgmap v252: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-04-06T03:38:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: osdmap e198: 8 total, 8 up, 8 in 2024-04-06T03:38:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2299160467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:42.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: pgmap v252: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:42.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:42.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: osdmap e198: 8 total, 8 up, 8 in 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2299160467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: pgmap v252: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3563833899' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi047-74473-31"}]': finished 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi047-74590-3","pool2":"test-rados-api-smithi047-74590-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: osdmap e198: 8 total, 8 up, 8 in 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2299160467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:42.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:42.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:43.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:43.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:43.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:43.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:43.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: osdmap e199: 8 total, 8 up, 8 in 2024-04-06T03:38:43.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:43.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: osdmap e199: 8 total, 8 up, 8 in 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi047-74496-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi047-74473-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: osdmap e199: 8 total, 8 up, 8 in 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:44.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:38:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:38:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:38:44.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[29365]: pgmap v255: 292 pgs: 32 creating+peering, 32 unknown, 228 active+clean; 583 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:44.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]': finished 2024-04-06T03:38:44.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]: dispatch 2024-04-06T03:38:44.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[29365]: osdmap e200: 8 total, 8 up, 8 in 2024-04-06T03:38:44.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]: dispatch 2024-04-06T03:38:44.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[37680]: pgmap v255: 292 pgs: 32 creating+peering, 32 unknown, 228 active+clean; 583 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:44.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]': finished 2024-04-06T03:38:44.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]: dispatch 2024-04-06T03:38:44.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[37680]: osdmap e200: 8 total, 8 up, 8 in 2024-04-06T03:38:44.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]: dispatch 2024-04-06T03:38:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:44 smithi102 ceph-mon[32821]: pgmap v255: 292 pgs: 32 creating+peering, 32 unknown, 228 active+clean; 583 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-21"}]': finished 2024-04-06T03:38:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]: dispatch 2024-04-06T03:38:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:44 smithi102 ceph-mon[32821]: osdmap e200: 8 total, 8 up, 8 in 2024-04-06T03:38:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]: dispatch 2024-04-06T03:38:45.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: pgmap v258: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:45.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:45.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:45.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]': finished 2024-04-06T03:38:45.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: osdmap e201: 8 total, 8 up, 8 in 2024-04-06T03:38:45.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3552182442' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:45.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: pgmap v258: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]': finished 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: osdmap e201: 8 total, 8 up, 8 in 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3552182442' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:45.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: pgmap v258: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:38:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi047-74473-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-21", "mode": "writeback"}]': finished 2024-04-06T03:38:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: osdmap e201: 8 total, 8 up, 8 in 2024-04-06T03:38:45.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3552182442' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:45.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:45.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:45.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:46.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:46.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:46.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:46.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[29365]: osdmap e202: 8 total, 8 up, 8 in 2024-04-06T03:38:46.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:46.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:46.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:46.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:46.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:46.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[37680]: osdmap e202: 8 total, 8 up, 8 in 2024-04-06T03:38:46.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:46.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:46 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:46 smithi102 ceph-mon[32821]: osdmap e202: 8 total, 8 up, 8 in 2024-04-06T03:38:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]: dispatch 2024-04-06T03:38:47.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[29365]: pgmap v261: 300 pgs: 300 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:38:47.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:47.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]': finished 2024-04-06T03:38:47.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[29365]: osdmap e203: 8 total, 8 up, 8 in 2024-04-06T03:38:47.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1538349173' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[37680]: pgmap v261: 300 pgs: 300 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]': finished 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[37680]: osdmap e203: 8 total, 8 up, 8 in 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1538349173' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:47.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:47 smithi102 ceph-mon[32821]: pgmap v261: 300 pgs: 300 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:38:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:47 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-21"}]': finished 2024-04-06T03:38:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:47 smithi102 ceph-mon[32821]: osdmap e203: 8 total, 8 up, 8 in 2024-04-06T03:38:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1538349173' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:47.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:47.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:48.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:48.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1538349173' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:48.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:48.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[29365]: osdmap e204: 8 total, 8 up, 8 in 2024-04-06T03:38:48.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:48.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:48.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:48.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1538349173' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:48.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:48.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[37680]: osdmap e204: 8 total, 8 up, 8 in 2024-04-06T03:38:48.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:48.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:38:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1538349173' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:48 smithi102 ceph-mon[32821]: osdmap e204: 8 total, 8 up, 8 in 2024-04-06T03:38:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1841830111' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:48.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]: dispatch 2024-04-06T03:38:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: pgmap v264: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:38:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: osdmap e205: 8 total, 8 up, 8 in 2024-04-06T03:38:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4069085479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: pgmap v264: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: osdmap e205: 8 total, 8 up, 8 in 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4069085479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:50.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: pgmap v264: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi047-74473-32"}]': finished 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: osdmap e205: 8 total, 8 up, 8 in 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4069085479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:50.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:50.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:51.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:51.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:51.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:51.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[29365]: osdmap e206: 8 total, 8 up, 8 in 2024-04-06T03:38:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[37680]: osdmap e206: 8 total, 8 up, 8 in 2024-04-06T03:38:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:51.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi047-74496-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:51.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:51.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi047-74473-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:51.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:51 smithi102 ceph-mon[32821]: osdmap e206: 8 total, 8 up, 8 in 2024-04-06T03:38:51.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:51.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:52.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:38:51 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:38:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: pgmap v267: 356 pgs: 96 unknown, 260 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: osdmap e207: 8 total, 8 up, 8 in 2024-04-06T03:38:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: osdmap e208: 8 total, 8 up, 8 in 2024-04-06T03:38:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:52.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: pgmap v267: 356 pgs: 96 unknown, 260 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:52.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: osdmap e207: 8 total, 8 up, 8 in 2024-04-06T03:38:52.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:52.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:52.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:52.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:52.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: osdmap e208: 8 total, 8 up, 8 in 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: pgmap v267: 356 pgs: 96 unknown, 260 active+clean; 584 KiB data, 580 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: osdmap e207: 8 total, 8 up, 8 in 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi047-74473-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: osdmap e208: 8 total, 8 up, 8 in 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:53.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:53.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]': finished 2024-04-06T03:38:53.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[37680]: osdmap e209: 8 total, 8 up, 8 in 2024-04-06T03:38:53.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]: dispatch 2024-04-06T03:38:53.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]: dispatch 2024-04-06T03:38:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]': finished 2024-04-06T03:38:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[29365]: osdmap e209: 8 total, 8 up, 8 in 2024-04-06T03:38:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]: dispatch 2024-04-06T03:38:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]: dispatch 2024-04-06T03:38:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:38:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-23"}]': finished 2024-04-06T03:38:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:53 smithi102 ceph-mon[32821]: osdmap e209: 8 total, 8 up, 8 in 2024-04-06T03:38:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]: dispatch 2024-04-06T03:38:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]: dispatch 2024-04-06T03:38:54.130 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:38:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:38:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:38:54.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: pgmap v270: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:38:54.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:54.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]': finished 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: osdmap e210: 8 total, 8 up, 8 in 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2785071497' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: pgmap v270: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]': finished 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: osdmap e210: 8 total, 8 up, 8 in 2024-04-06T03:38:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2785071497' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:54.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:54.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:54.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: pgmap v270: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-23", "mode": "writeback"}]': finished 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: osdmap e210: 8 total, 8 up, 8 in 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2785071497' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[37680]: pgmap v273: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:38:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[37680]: osdmap e211: 8 total, 8 up, 8 in 2024-04-06T03:38:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[29365]: pgmap v273: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[29365]: osdmap e211: 8 total, 8 up, 8 in 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:55 smithi102 ceph-mon[32821]: pgmap v273: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:38:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:55 smithi102 ceph-mon[32821]: osdmap e211: 8 total, 8 up, 8 in 2024-04-06T03:38:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2833504676' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]: dispatch 2024-04-06T03:38:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:38:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: osdmap e212: 8 total, 8 up, 8 in 2024-04-06T03:38:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2889073198' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:57.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:57.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]': finished 2024-04-06T03:38:57.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:57.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:57.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:57.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: osdmap e212: 8 total, 8 up, 8 in 2024-04-06T03:38:57.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2889073198' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:57.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:57.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]': finished 2024-04-06T03:38:57.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:57.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi047-74473-33"}]': finished 2024-04-06T03:38:57.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:38:57.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: osdmap e212: 8 total, 8 up, 8 in 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2889073198' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-23"}]': finished 2024-04-06T03:38:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi047-74473-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:38:58.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:58 smithi047 ceph-mon[29365]: pgmap v276: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:38:58.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:58 smithi047 ceph-mon[29365]: osdmap e213: 8 total, 8 up, 8 in 2024-04-06T03:38:58.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:58.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:58.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:58 smithi047 ceph-mon[37680]: pgmap v276: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:38:58.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:58 smithi047 ceph-mon[37680]: osdmap e213: 8 total, 8 up, 8 in 2024-04-06T03:38:58.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:58.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:58 smithi102 ceph-mon[32821]: pgmap v276: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:38:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:58 smithi102 ceph-mon[32821]: osdmap e213: 8 total, 8 up, 8 in 2024-04-06T03:38:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:38:59.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[29365]: osdmap e214: 8 total, 8 up, 8 in 2024-04-06T03:38:59.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1311994951' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:38:59.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:59.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[29365]: osdmap e215: 8 total, 8 up, 8 in 2024-04-06T03:38:59.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[37680]: osdmap e214: 8 total, 8 up, 8 in 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1311994951' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[37680]: osdmap e215: 8 total, 8 up, 8 in 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:38:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:59 smithi102 ceph-mon[32821]: osdmap e214: 8 total, 8 up, 8 in 2024-04-06T03:38:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1311994951' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi047-74473-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:38:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:38:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:59 smithi102 ceph-mon[32821]: osdmap e215: 8 total, 8 up, 8 in 2024-04-06T03:38:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:38:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:38:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:00.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[29365]: pgmap v279: 324 pgs: 32 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:39:00.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:00.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[29365]: osdmap e216: 8 total, 8 up, 8 in 2024-04-06T03:39:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4020291598' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[37680]: pgmap v279: 324 pgs: 32 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:39:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[37680]: osdmap e216: 8 total, 8 up, 8 in 2024-04-06T03:39:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4020291598' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:00 smithi102 ceph-mon[32821]: pgmap v279: 324 pgs: 32 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:39:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:00 smithi102 ceph-mon[32821]: osdmap e216: 8 total, 8 up, 8 in 2024-04-06T03:39:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4020291598' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:02.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:39:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-mon[32821]: pgmap v282: 396 pgs: 104 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-mon[32821]: osdmap e217: 8 total, 8 up, 8 in 2024-04-06T03:39:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:02.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:02.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:01 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[29365]: pgmap v282: 396 pgs: 104 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[29365]: osdmap e217: 8 total, 8 up, 8 in 2024-04-06T03:39:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[37680]: pgmap v282: 396 pgs: 104 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 573 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[37680]: osdmap e217: 8 total, 8 up, 8 in 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:01 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:39:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: osdmap e218: 8 total, 8 up, 8 in 2024-04-06T03:39:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3830368733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]': finished 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3830368733' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: osdmap e219: 8 total, 8 up, 8 in 2024-04-06T03:39:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]: dispatch 2024-04-06T03:39:03.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:39:03.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:03.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: osdmap e218: 8 total, 8 up, 8 in 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3830368733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]': finished 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3830368733' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:03.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: osdmap e219: 8 total, 8 up, 8 in 2024-04-06T03:39:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]: dispatch 2024-04-06T03:39:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:39:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: osdmap e218: 8 total, 8 up, 8 in 2024-04-06T03:39:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1473794489' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]: dispatch 2024-04-06T03:39:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3830368733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi047-74473-34"}]': finished 2024-04-06T03:39:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-25"}]': finished 2024-04-06T03:39:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3830368733' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi047-74496-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: osdmap e219: 8 total, 8 up, 8 in 2024-04-06T03:39:03.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]: dispatch 2024-04-06T03:39:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: pgmap v285: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:39:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]: dispatch 2024-04-06T03:39:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi047-74473-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:04.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]': finished 2024-04-06T03:39:04.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi047-74473-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:04.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: osdmap e220: 8 total, 8 up, 8 in 2024-04-06T03:39:04.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi047-74473-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:04.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:39:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:39:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: pgmap v285: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]: dispatch 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi047-74473-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]': finished 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi047-74473-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: osdmap e220: 8 total, 8 up, 8 in 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi047-74473-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: pgmap v285: 420 pgs: 32 unknown, 388 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:39:04.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]: dispatch 2024-04-06T03:39:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi047-74473-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-25", "mode": "writeback"}]': finished 2024-04-06T03:39:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi047-74473-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: osdmap e220: 8 total, 8 up, 8 in 2024-04-06T03:39:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi047-74473-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:05.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:05.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:05.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:06 smithi102 ceph-mon[32821]: pgmap v288: 388 pgs: 388 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:39:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:06 smithi102 ceph-mon[32821]: osdmap e221: 8 total, 8 up, 8 in 2024-04-06T03:39:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:06 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi047-74473-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]': finished 2024-04-06T03:39:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:06 smithi102 ceph-mon[32821]: osdmap e222: 8 total, 8 up, 8 in 2024-04-06T03:39:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[37680]: pgmap v288: 388 pgs: 388 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:39:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[37680]: osdmap e221: 8 total, 8 up, 8 in 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi047-74473-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]': finished 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[37680]: osdmap e222: 8 total, 8 up, 8 in 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[29365]: pgmap v288: 388 pgs: 388 active+clean; 584 KiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[29365]: osdmap e221: 8 total, 8 up, 8 in 2024-04-06T03:39:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]: dispatch 2024-04-06T03:39:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi047-74473-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-25"}]': finished 2024-04-06T03:39:06.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:06 smithi047 ceph-mon[29365]: osdmap e222: 8 total, 8 up, 8 in 2024-04-06T03:39:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:07 smithi102 ceph-mon[32821]: pgmap v291: 332 pgs: 8 creating+peering, 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:39:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:07 smithi102 ceph-mon[32821]: osdmap e223: 8 total, 8 up, 8 in 2024-04-06T03:39:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:07 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:07 smithi047 ceph-mon[29365]: pgmap v291: 332 pgs: 8 creating+peering, 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:39:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:07 smithi047 ceph-mon[29365]: osdmap e223: 8 total, 8 up, 8 in 2024-04-06T03:39:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:07 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:08.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:07 smithi047 ceph-mon[37680]: pgmap v291: 332 pgs: 8 creating+peering, 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:39:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:07 smithi047 ceph-mon[37680]: osdmap e223: 8 total, 8 up, 8 in 2024-04-06T03:39:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:07 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:08 smithi102 ceph-mon[32821]: osdmap e224: 8 total, 8 up, 8 in 2024-04-06T03:39:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:08 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:39:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:09.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[29365]: osdmap e224: 8 total, 8 up, 8 in 2024-04-06T03:39:09.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:09.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:09.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:09.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:39:09.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:09.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[37680]: osdmap e224: 8 total, 8 up, 8 in 2024-04-06T03:39:09.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:09.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:09.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:09.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:39:09.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: pgmap v294: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: osdmap e225: 8 total, 8 up, 8 in 2024-04-06T03:39:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1598568039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:39:10.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:39:10.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:10.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:10.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:09 smithi102 ceph-mon[32821]: osdmap e226: 8 total, 8 up, 8 in 2024-04-06T03:39:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: pgmap v294: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: osdmap e225: 8 total, 8 up, 8 in 2024-04-06T03:39:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1598568039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[37680]: osdmap e226: 8 total, 8 up, 8 in 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: pgmap v294: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: osdmap e225: 8 total, 8 up, 8 in 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1598568039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:10.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]: dispatch 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3892332549' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi047-74473-35"}]': finished 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi047-74496-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:10.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:09 smithi047 ceph-mon[29365]: osdmap e226: 8 total, 8 up, 8 in 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi047-74473-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi047-74473-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: osdmap e227: 8 total, 8 up, 8 in 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:11.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi047-74473-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:11.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:11.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:11.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi047-74473-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi047-74473-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: osdmap e227: 8 total, 8 up, 8 in 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi047-74473-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi047-74473-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:11.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:11.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi047-74473-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:11.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: osdmap e227: 8 total, 8 up, 8 in 2024-04-06T03:39:11.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:11.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi047-74473-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:11.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:12 smithi102 ceph-mon[32821]: pgmap v297: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]': finished 2024-04-06T03:39:12.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:39:11 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:39:12.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:12 smithi047 ceph-mon[29365]: pgmap v297: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:12.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]': finished 2024-04-06T03:39:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:12 smithi047 ceph-mon[37680]: pgmap v297: 292 pgs: 64 unknown, 228 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-27"}]': finished 2024-04-06T03:39:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]: dispatch 2024-04-06T03:39:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: osdmap e228: 8 total, 8 up, 8 in 2024-04-06T03:39:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3589760786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]: dispatch 2024-04-06T03:39:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi047-74473-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]': finished 2024-04-06T03:39:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:13 smithi102 ceph-mon[32821]: osdmap e229: 8 total, 8 up, 8 in 2024-04-06T03:39:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]: dispatch 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: osdmap e228: 8 total, 8 up, 8 in 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3589760786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]: dispatch 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi047-74473-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]': finished 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[29365]: osdmap e229: 8 total, 8 up, 8 in 2024-04-06T03:39:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]: dispatch 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: osdmap e228: 8 total, 8 up, 8 in 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3589760786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]: dispatch 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi047-74473-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-27", "mode": "writeback"}]': finished 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi047-74496-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-mon[37680]: osdmap e229: 8 total, 8 up, 8 in 2024-04-06T03:39:14.083 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:39:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:39:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:39:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: pgmap v300: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:39:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: osdmap e230: 8 total, 8 up, 8 in 2024-04-06T03:39:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: pgmap v300: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:39:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: osdmap e230: 8 total, 8 up, 8 in 2024-04-06T03:39:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: pgmap v300: 292 pgs: 32 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: osdmap e230: 8 total, 8 up, 8 in 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:14.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:14.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:14.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:14.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: pgmap v303: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:39:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: osdmap e231: 8 total, 8 up, 8 in 2024-04-06T03:39:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:16.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:16.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:16.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: pgmap v303: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: osdmap e231: 8 total, 8 up, 8 in 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: pgmap v303: 268 pgs: 8 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: osdmap e231: 8 total, 8 up, 8 in 2024-04-06T03:39:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:16.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:16.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:16.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:16.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]: dispatch 2024-04-06T03:39:17.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:17.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:17.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]': finished 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[37680]: osdmap e232: 8 total, 8 up, 8 in 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[37680]: osdmap e233: 8 total, 8 up, 8 in 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]': finished 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[29365]: osdmap e232: 8 total, 8 up, 8 in 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:17.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:17.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:17 smithi047 ceph-mon[29365]: osdmap e233: 8 total, 8 up, 8 in 2024-04-06T03:39:17.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:17 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:17.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:17.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-27"}]': finished 2024-04-06T03:39:17.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:17 smithi102 ceph-mon[32821]: osdmap e232: 8 total, 8 up, 8 in 2024-04-06T03:39:17.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]: dispatch 2024-04-06T03:39:17.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:17.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3293438356' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi047-74473-36"}]': finished 2024-04-06T03:39:17.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:17 smithi102 ceph-mon[32821]: osdmap e233: 8 total, 8 up, 8 in 2024-04-06T03:39:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: pgmap v306: 260 pgs: 260 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:39:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: osdmap e234: 8 total, 8 up, 8 in 2024-04-06T03:39:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi047-74473-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: pgmap v306: 260 pgs: 260 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: osdmap e234: 8 total, 8 up, 8 in 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi047-74473-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:18.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: pgmap v306: 260 pgs: 260 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:39:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: osdmap e234: 8 total, 8 up, 8 in 2024-04-06T03:39:18.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi047-74473-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:18.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:18.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:19 smithi102 ceph-mon[32821]: pgmap v309: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:19 smithi102 ceph-mon[32821]: osdmap e235: 8 total, 8 up, 8 in 2024-04-06T03:39:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:19 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[37680]: pgmap v309: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[37680]: osdmap e235: 8 total, 8 up, 8 in 2024-04-06T03:39:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[29365]: pgmap v309: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[29365]: osdmap e235: 8 total, 8 up, 8 in 2024-04-06T03:39:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:19 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi047-74473-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: osdmap e236: 8 total, 8 up, 8 in 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: osdmap e237: 8 total, 8 up, 8 in 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi047-74473-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: osdmap e236: 8 total, 8 up, 8 in 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: osdmap e237: 8 total, 8 up, 8 in 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:21.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi047-74473-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: osdmap e236: 8 total, 8 up, 8 in 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2702202967' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]: dispatch 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-46"}]': finished 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: osdmap e237: 8 total, 8 up, 8 in 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: pgmap v312: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: osdmap e238: 8 total, 8 up, 8 in 2024-04-06T03:39:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: pgmap v312: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: osdmap e238: 8 total, 8 up, 8 in 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:22.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:22.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:39:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: pgmap v312: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi047-74496-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: osdmap e238: 8 total, 8 up, 8 in 2024-04-06T03:39:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]': finished 2024-04-06T03:39:23.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:23.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]': finished 2024-04-06T03:39:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-29"}]': finished 2024-04-06T03:39:24.057 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:39:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:39:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:39:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: pgmap v315: 260 pgs: 260 active+clean; 4.6 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]: dispatch 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: osdmap e239: 8 total, 8 up, 8 in 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]: dispatch 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]': finished 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: osdmap e240: 8 total, 8 up, 8 in 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: pgmap v315: 260 pgs: 260 active+clean; 4.6 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]: dispatch 2024-04-06T03:39:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: osdmap e239: 8 total, 8 up, 8 in 2024-04-06T03:39:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]: dispatch 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]': finished 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: osdmap e240: 8 total, 8 up, 8 in 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: pgmap v315: 260 pgs: 260 active+clean; 4.6 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]: dispatch 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: osdmap e239: 8 total, 8 up, 8 in 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]: dispatch 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]: dispatch 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi047-74496-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/788332144' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi047-74473-37"}]': finished 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-29", "mode": "writeback"}]': finished 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: osdmap e240: 8 total, 8 up, 8 in 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:24.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:24.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:26 smithi102 ceph-mon[32821]: pgmap v318: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:26.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:26.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:26 smithi102 ceph-mon[32821]: osdmap e241: 8 total, 8 up, 8 in 2024-04-06T03:39:26.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:26.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:26.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:26 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:26.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[29365]: pgmap v318: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:26.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:26.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[29365]: osdmap e241: 8 total, 8 up, 8 in 2024-04-06T03:39:26.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:26.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:26.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[37680]: pgmap v318: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi047-74473-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[37680]: osdmap e241: 8 total, 8 up, 8 in 2024-04-06T03:39:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:26 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: osdmap e242: 8 total, 8 up, 8 in 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: osdmap e243: 8 total, 8 up, 8 in 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:27.395 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: osdmap e242: 8 total, 8 up, 8 in 2024-04-06T03:39:27.425 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:27.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:27.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: osdmap e243: 8 total, 8 up, 8 in 2024-04-06T03:39:27.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:27.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: osdmap e242: 8 total, 8 up, 8 in 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi047-74473-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: osdmap e243: 8 total, 8 up, 8 in 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1424391084' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]: dispatch 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:27.427 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: pgmap v321: 260 pgs: 260 active+clean; 8.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-04-06T03:39:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: osdmap e244: 8 total, 8 up, 8 in 2024-04-06T03:39:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:28.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: pgmap v321: 260 pgs: 260 active+clean; 8.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-04-06T03:39:28.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:28.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: osdmap e244: 8 total, 8 up, 8 in 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: pgmap v321: 260 pgs: 260 active+clean; 8.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi047-74496-47"}]': finished 2024-04-06T03:39:28.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: osdmap e244: 8 total, 8 up, 8 in 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]: dispatch 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:28.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:29 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]': finished 2024-04-06T03:39:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:29 smithi102 ceph-mon[32821]: osdmap e245: 8 total, 8 up, 8 in 2024-04-06T03:39:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:29.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:29.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]': finished 2024-04-06T03:39:29.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[29365]: osdmap e245: 8 total, 8 up, 8 in 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-29"}]': finished 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi047-74496-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[37680]: osdmap e245: 8 total, 8 up, 8 in 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:29.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:29.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:30.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:30 smithi102 ceph-mon[32821]: pgmap v324: 268 pgs: 8 unknown, 260 active+clean; 8.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-04-06T03:39:30.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:30.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:30.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:30 smithi102 ceph-mon[32821]: osdmap e246: 8 total, 8 up, 8 in 2024-04-06T03:39:30.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:30.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[37680]: pgmap v324: 268 pgs: 8 unknown, 260 active+clean; 8.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-04-06T03:39:30.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:30.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:30.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[37680]: osdmap e246: 8 total, 8 up, 8 in 2024-04-06T03:39:30.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:30.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[29365]: pgmap v324: 268 pgs: 8 unknown, 260 active+clean; 8.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 26 op/s 2024-04-06T03:39:30.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:30.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2878554215' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:30.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[29365]: osdmap e246: 8 total, 8 up, 8 in 2024-04-06T03:39:30.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]: dispatch 2024-04-06T03:39:32.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:39:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: pgmap v327: 228 pgs: 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: osdmap e247: 8 total, 8 up, 8 in 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:32.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:31 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:32.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: pgmap v327: 228 pgs: 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: osdmap e247: 8 total, 8 up, 8 in 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: pgmap v327: 228 pgs: 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi047-74496-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi047-74473-38"}]': finished 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: osdmap e247: 8 total, 8 up, 8 in 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:32.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:32.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:32.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:31 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:32 smithi102 ceph-mon[32821]: osdmap e248: 8 total, 8 up, 8 in 2024-04-06T03:39:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:32 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:33.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:33.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:33.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[29365]: osdmap e248: 8 total, 8 up, 8 in 2024-04-06T03:39:33.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:33.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi047-74473-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[37680]: osdmap e248: 8 total, 8 up, 8 in 2024-04-06T03:39:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:32 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:33 smithi102 ceph-mon[32821]: pgmap v330: 268 pgs: 40 creating+peering, 228 active+clean; 4.6 MiB data, 578 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:33 smithi102 ceph-mon[32821]: osdmap e249: 8 total, 8 up, 8 in 2024-04-06T03:39:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:34.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:39:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:39:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[29365]: pgmap v330: 268 pgs: 40 creating+peering, 228 active+clean; 4.6 MiB data, 578 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[29365]: osdmap e249: 8 total, 8 up, 8 in 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[37680]: pgmap v330: 268 pgs: 40 creating+peering, 228 active+clean; 4.6 MiB data, 578 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[37680]: osdmap e249: 8 total, 8 up, 8 in 2024-04-06T03:39:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]': finished 2024-04-06T03:39:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:34 smithi102 ceph-mon[32821]: osdmap e250: 8 total, 8 up, 8 in 2024-04-06T03:39:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]: dispatch 2024-04-06T03:39:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]: dispatch 2024-04-06T03:39:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:35.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:35.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]': finished 2024-04-06T03:39:35.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:35.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[29365]: osdmap e250: 8 total, 8 up, 8 in 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]: dispatch 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]: dispatch 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi047-74473-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-31"}]': finished 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[37680]: osdmap e250: 8 total, 8 up, 8 in 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]: dispatch 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4121358648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]: dispatch 2024-04-06T03:39:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]: dispatch 2024-04-06T03:39:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: pgmap v333: 268 pgs: 8 unknown, 32 creating+peering, 228 active+clean; 4.6 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]': finished 2024-04-06T03:39:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: osdmap e251: 8 total, 8 up, 8 in 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: osdmap e252: 8 total, 8 up, 8 in 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:36.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:36.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: pgmap v333: 268 pgs: 8 unknown, 32 creating+peering, 228 active+clean; 4.6 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]': finished 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: osdmap e251: 8 total, 8 up, 8 in 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: osdmap e252: 8 total, 8 up, 8 in 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: pgmap v333: 268 pgs: 8 unknown, 32 creating+peering, 228 active+clean; 4.6 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-31", "mode": "writeback"}]': finished 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi047-74496-48"}]': finished 2024-04-06T03:39:36.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: osdmap e251: 8 total, 8 up, 8 in 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi047-74496-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: osdmap e252: 8 total, 8 up, 8 in 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:36.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]: dispatch 2024-04-06T03:39:36.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:36.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:36.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:37 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]': finished 2024-04-06T03:39:37.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:37 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:37.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]': finished 2024-04-06T03:39:37.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:37 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-31"}]': finished 2024-04-06T03:39:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: pgmap v336: 260 pgs: 260 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:39:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: osdmap e253: 8 total, 8 up, 8 in 2024-04-06T03:39:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:38.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:38.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:38 smithi102 ceph-mon[32821]: osdmap e254: 8 total, 8 up, 8 in 2024-04-06T03:39:38.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: pgmap v336: 260 pgs: 260 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:39:38.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:38.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:38.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: osdmap e253: 8 total, 8 up, 8 in 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[29365]: osdmap e254: 8 total, 8 up, 8 in 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: pgmap v336: 260 pgs: 260 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3093712737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: osdmap e253: 8 total, 8 up, 8 in 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:38.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]: dispatch 2024-04-06T03:39:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi047-74496-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi047-74473-39"}]': finished 2024-04-06T03:39:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:38 smithi047 ceph-mon[37680]: osdmap e254: 8 total, 8 up, 8 in 2024-04-06T03:39:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:39.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:39.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:39.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: osdmap e255: 8 total, 8 up, 8 in 2024-04-06T03:39:39.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:39.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:39.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: osdmap e255: 8 total, 8 up, 8 in 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi047-74473-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: osdmap e255: 8 total, 8 up, 8 in 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:39.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:40 smithi102 ceph-mon[32821]: pgmap v339: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:40 smithi102 ceph-mon[32821]: osdmap e256: 8 total, 8 up, 8 in 2024-04-06T03:39:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[29365]: pgmap v339: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[29365]: osdmap e256: 8 total, 8 up, 8 in 2024-04-06T03:39:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:40.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[37680]: pgmap v339: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[37680]: osdmap e256: 8 total, 8 up, 8 in 2024-04-06T03:39:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:42.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:39:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: pgmap v342: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: osdmap e257: 8 total, 8 up, 8 in 2024-04-06T03:39:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: pgmap v342: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: osdmap e257: 8 total, 8 up, 8 in 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: pgmap v342: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 583 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi047-74473-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: osdmap e257: 8 total, 8 up, 8 in 2024-04-06T03:39:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3309145997' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:42.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:42.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]: dispatch 2024-04-06T03:39:42.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]': finished 2024-04-06T03:39:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: osdmap e258: 8 total, 8 up, 8 in 2024-04-06T03:39:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]: dispatch 2024-04-06T03:39:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]: dispatch 2024-04-06T03:39:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi047-74496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]': finished 2024-04-06T03:39:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi047-74496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: osdmap e259: 8 total, 8 up, 8 in 2024-04-06T03:39:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi047-74496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:43.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:43.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]': finished 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: osdmap e258: 8 total, 8 up, 8 in 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]: dispatch 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]: dispatch 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi047-74496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]': finished 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi047-74496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: osdmap e259: 8 total, 8 up, 8 in 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi047-74496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi047-74496-49"}]': finished 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-33"}]': finished 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: osdmap e258: 8 total, 8 up, 8 in 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]: dispatch 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]: dispatch 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi047-74496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-33", "mode": "writeback"}]': finished 2024-04-06T03:39:43.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi047-74496-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:43.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: osdmap e259: 8 total, 8 up, 8 in 2024-04-06T03:39:43.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi047-74496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:43.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:43.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:44.070 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:39:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:39:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:44 smithi102 ceph-mon[32821]: pgmap v345: 268 pgs: 8 creating+peering, 260 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:44 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:44.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[29365]: pgmap v345: 268 pgs: 8 creating+peering, 260 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:44.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:44.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[37680]: pgmap v345: 268 pgs: 8 creating+peering, 260 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:45.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:45.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:45.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:45.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: osdmap e260: 8 total, 8 up, 8 in 2024-04-06T03:39:45.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:45.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:45.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:45.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi047-74496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:45.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]': finished 2024-04-06T03:39:45.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:45.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: osdmap e261: 8 total, 8 up, 8 in 2024-04-06T03:39:45.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:45.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:45.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: osdmap e260: 8 total, 8 up, 8 in 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi047-74496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]': finished 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: osdmap e261: 8 total, 8 up, 8 in 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/734399853' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: osdmap e260: 8 total, 8 up, 8 in 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]: dispatch 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]: dispatch 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi047-74496-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-33"}]': finished 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi047-74473-40"}]': finished 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: osdmap e261: 8 total, 8 up, 8 in 2024-04-06T03:39:45.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:45.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:45.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:46 smithi102 ceph-mon[32821]: pgmap v348: 260 pgs: 260 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:46 smithi102 ceph-mon[32821]: osdmap e262: 8 total, 8 up, 8 in 2024-04-06T03:39:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:46.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[29365]: pgmap v348: 260 pgs: 260 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:46.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:46.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[29365]: osdmap e262: 8 total, 8 up, 8 in 2024-04-06T03:39:46.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:46.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:46.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[37680]: pgmap v348: 260 pgs: 260 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:39:46.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi047-74473-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:46.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[37680]: osdmap e262: 8 total, 8 up, 8 in 2024-04-06T03:39:46.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:46.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:48.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:47 smithi102 ceph-mon[32821]: pgmap v351: 236 pgs: 236 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:39:48.350 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:47 smithi102 ceph-mon[32821]: osdmap e263: 8 total, 8 up, 8 in 2024-04-06T03:39:48.350 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:48.350 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:48.350 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:48.351 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[29365]: pgmap v351: 236 pgs: 236 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:39:48.351 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[29365]: osdmap e263: 8 total, 8 up, 8 in 2024-04-06T03:39:48.351 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:48.351 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:48.351 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:48.352 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[37680]: pgmap v351: 236 pgs: 236 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:39:48.352 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[37680]: osdmap e263: 8 total, 8 up, 8 in 2024-04-06T03:39:48.352 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:48.352 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:48.352 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:48 smithi102 ceph-mon[32821]: osdmap e264: 8 total, 8 up, 8 in 2024-04-06T03:39:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:49.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:49.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:49.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[37680]: osdmap e264: 8 total, 8 up, 8 in 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi047-74473-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[29365]: osdmap e264: 8 total, 8 up, 8 in 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]: dispatch 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:49.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:39:49.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:39:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[29365]: pgmap v354: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[29365]: osdmap e265: 8 total, 8 up, 8 in 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[37680]: pgmap v354: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[37680]: osdmap e265: 8 total, 8 up, 8 in 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:49 smithi102 ceph-mon[32821]: pgmap v354: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/628658407' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi047-74496-50"}]': finished 2024-04-06T03:39:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:39:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:49 smithi102 ceph-mon[32821]: osdmap e265: 8 total, 8 up, 8 in 2024-04-06T03:39:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: osdmap e266: 8 total, 8 up, 8 in 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]: dispatch 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1709566008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]: dispatch 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1709566008' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]': finished 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: osdmap e267: 8 total, 8 up, 8 in 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: osdmap e266: 8 total, 8 up, 8 in 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]: dispatch 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1709566008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]: dispatch 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1709566008' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]': finished 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:51.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: osdmap e267: 8 total, 8 up, 8 in 2024-04-06T03:39:51.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: osdmap e266: 8 total, 8 up, 8 in 2024-04-06T03:39:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]: dispatch 2024-04-06T03:39:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1709566008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]: dispatch 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1709566008' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi047-74496-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-35", "mode": "writeback"}]': finished 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: osdmap e267: 8 total, 8 up, 8 in 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2752465193' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]: dispatch 2024-04-06T03:39:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:51 smithi047 ceph-mon[29365]: pgmap v357: 292 pgs: 64 unknown, 228 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:51 smithi047 ceph-mon[29365]: osdmap e268: 8 total, 8 up, 8 in 2024-04-06T03:39:52.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:51 smithi047 ceph-mon[37680]: pgmap v357: 292 pgs: 64 unknown, 228 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:52.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:52.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:51 smithi047 ceph-mon[37680]: osdmap e268: 8 total, 8 up, 8 in 2024-04-06T03:39:52.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:39:51 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:39:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:51 smithi102 ceph-mon[32821]: pgmap v357: 292 pgs: 64 unknown, 228 active+clean; 4.6 MiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:39:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi047-74473-41"}]': finished 2024-04-06T03:39:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:51 smithi102 ceph-mon[32821]: osdmap e268: 8 total, 8 up, 8 in 2024-04-06T03:39:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:53.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:52 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:53.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:53.339 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.339 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:53.339 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:53.339 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.339 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.339 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:39:53.339 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:52 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:39:54.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:39:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:39:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:39:54.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: pgmap v360: 260 pgs: 260 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:54.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: osdmap e269: 8 total, 8 up, 8 in 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi047-74496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: pgmap v360: 260 pgs: 260 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:54.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: osdmap e269: 8 total, 8 up, 8 in 2024-04-06T03:39:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi047-74496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:54.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: pgmap v360: 260 pgs: 260 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:54.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:39:54.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:54.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi047-74473-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:39:54.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: osdmap e269: 8 total, 8 up, 8 in 2024-04-06T03:39:54.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:54.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi047-74496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:54.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:54.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:54.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:55.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: osdmap e270: 8 total, 8 up, 8 in 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: pgmap v363: 260 pgs: 260 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi047-74496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[29365]: osdmap e271: 8 total, 8 up, 8 in 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: osdmap e270: 8 total, 8 up, 8 in 2024-04-06T03:39:55.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:55.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: pgmap v363: 260 pgs: 260 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:55.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi047-74496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:55.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:55.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:55.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:55 smithi047 ceph-mon[37680]: osdmap e271: 8 total, 8 up, 8 in 2024-04-06T03:39:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: osdmap e270: 8 total, 8 up, 8 in 2024-04-06T03:39:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: pgmap v363: 260 pgs: 260 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:39:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi047-74496-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi047-74473-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:55.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:55 smithi102 ceph-mon[32821]: osdmap e271: 8 total, 8 up, 8 in 2024-04-06T03:39:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:56 smithi047 ceph-mon[29365]: osdmap e272: 8 total, 8 up, 8 in 2024-04-06T03:39:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:57.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:56 smithi047 ceph-mon[37680]: osdmap e272: 8 total, 8 up, 8 in 2024-04-06T03:39:57.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:57.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:57.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:56 smithi102 ceph-mon[32821]: osdmap e272: 8 total, 8 up, 8 in 2024-04-06T03:39:57.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:57.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:39:58.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[29365]: pgmap v366: 276 pgs: 276 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:39:58.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:58.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[29365]: osdmap e273: 8 total, 8 up, 8 in 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[37680]: pgmap v366: 276 pgs: 276 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[37680]: osdmap e273: 8 total, 8 up, 8 in 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:58.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:58.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:57 smithi102 ceph-mon[32821]: pgmap v366: 276 pgs: 276 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:39:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:39:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:57 smithi102 ceph-mon[32821]: osdmap e273: 8 total, 8 up, 8 in 2024-04-06T03:39:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]: dispatch 2024-04-06T03:39:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:58.891 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7014 ms) 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6981 ms) 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6990 ms) 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7015 ms) 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7028 ms) 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7002 ms) 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7021 ms) 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-04-06T03:39:58.892 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6941 ms) 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7013 ms) 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7274 ms) 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6719 ms) 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6998 ms) 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7007 ms) 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7013 ms) 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7020 ms) 2024-04-06T03:39:58.893 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-04-06T03:39:58.894 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7042 ms) 2024-04-06T03:39:58.894 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112078 ms total) 2024-04-06T03:39:58.894 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: 2024-04-06T03:39:58.894 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [----------] Global test environment tear-down 2024-04-06T03:39:58.894 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (208266 ms total) 2024-04-06T03:39:58.894 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio: [ PASSED ] 42 tests. 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: osdmap e274: 8 total, 8 up, 8 in 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[29365]: osdmap e275: 8 total, 8 up, 8 in 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: osdmap e274: 8 total, 8 up, 8 in 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:59.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:59.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:39:59 smithi047 ceph-mon[37680]: osdmap e275: 8 total, 8 up, 8 in 2024-04-06T03:39:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:39:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-35"}]': finished 2024-04-06T03:39:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: osdmap e274: 8 total, 8 up, 8 in 2024-04-06T03:39:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]: dispatch 2024-04-06T03:39:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1241499906' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]: dispatch 2024-04-06T03:39:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4072165302' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi047-74496-52"}]': finished 2024-04-06T03:39:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi047-74473-42"}]': finished 2024-04-06T03:39:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:39:59 smithi102 ceph-mon[32821]: osdmap e275: 8 total, 8 up, 8 in 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: pgmap v369: 260 pgs: 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: osdmap e276: 8 total, 8 up, 8 in 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[29365]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: pgmap v369: 260 pgs: 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:00.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: osdmap e276: 8 total, 8 up, 8 in 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:00.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-04-06T03:40:00.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-04-06T03:40:00.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T03:40:00.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T03:40:00.498 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:00 smithi047 ceph-mon[37680]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T03:40:00.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: pgmap v369: 260 pgs: 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:40:00.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:00.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.587 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: osdmap e276: 8 total, 8 up, 8 in 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T03:40:00.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T03:40:00.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:00 smithi102 ceph-mon[32821]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T03:40:02.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:40:01 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:40:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:01 smithi102 ceph-mon[32821]: pgmap v372: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:02.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:01 smithi102 ceph-mon[32821]: osdmap e277: 8 total, 8 up, 8 in 2024-04-06T03:40:02.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[29365]: pgmap v372: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[29365]: osdmap e277: 8 total, 8 up, 8 in 2024-04-06T03:40:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[37680]: pgmap v372: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[37680]: osdmap e277: 8 total, 8 up, 8 in 2024-04-06T03:40:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:02 smithi102 ceph-mon[32821]: osdmap e278: 8 total, 8 up, 8 in 2024-04-06T03:40:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:02 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]': finished 2024-04-06T03:40:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:02 smithi102 ceph-mon[32821]: osdmap e279: 8 total, 8 up, 8 in 2024-04-06T03:40:03.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:03.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:03.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[29365]: osdmap e278: 8 total, 8 up, 8 in 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]': finished 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[29365]: osdmap e279: 8 total, 8 up, 8 in 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi047-74496-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[37680]: osdmap e278: 8 total, 8 up, 8 in 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:03.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:03.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-37"}]': finished 2024-04-06T03:40:03.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:02 smithi047 ceph-mon[37680]: osdmap e279: 8 total, 8 up, 8 in 2024-04-06T03:40:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: pgmap v375: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-06T03:40:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]: dispatch 2024-04-06T03:40:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]: dispatch 2024-04-06T03:40:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]': finished 2024-04-06T03:40:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: osdmap e280: 8 total, 8 up, 8 in 2024-04-06T03:40:04.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:04.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:04.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:40:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:40:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: pgmap v375: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-06T03:40:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]: dispatch 2024-04-06T03:40:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]: dispatch 2024-04-06T03:40:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]': finished 2024-04-06T03:40:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: osdmap e280: 8 total, 8 up, 8 in 2024-04-06T03:40:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: pgmap v375: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]: dispatch 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]: dispatch 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-37", "mode": "writeback"}]': finished 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: osdmap e280: 8 total, 8 up, 8 in 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:40:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: osdmap e281: 8 total, 8 up, 8 in 2024-04-06T03:40:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:05.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:05.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:05.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:05.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:05.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: osdmap e281: 8 total, 8 up, 8 in 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:40:05.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: osdmap e281: 8 total, 8 up, 8 in 2024-04-06T03:40:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1056330180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]: dispatch 2024-04-06T03:40:05.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]: dispatch 2024-04-06T03:40:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:05 smithi102 ceph-mon[32821]: pgmap v378: 260 pgs: 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:05 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:05 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:40:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]': finished 2024-04-06T03:40:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:05 smithi102 ceph-mon[32821]: osdmap e282: 8 total, 8 up, 8 in 2024-04-06T03:40:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[37680]: pgmap v378: 260 pgs: 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:40:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]': finished 2024-04-06T03:40:06.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[37680]: osdmap e282: 8 total, 8 up, 8 in 2024-04-06T03:40:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[29365]: pgmap v378: 260 pgs: 260 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:40:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi047-74496-53"}]': finished 2024-04-06T03:40:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-37"}]': finished 2024-04-06T03:40:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:05 smithi047 ceph-mon[29365]: osdmap e282: 8 total, 8 up, 8 in 2024-04-06T03:40:07.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:08.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[37680]: pgmap v381: 260 pgs: 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-06T03:40:08.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:08.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[37680]: osdmap e283: 8 total, 8 up, 8 in 2024-04-06T03:40:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:08.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[29365]: pgmap v381: 260 pgs: 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-06T03:40:08.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:08.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[29365]: osdmap e283: 8 total, 8 up, 8 in 2024-04-06T03:40:08.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:08.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:08 smithi102 ceph-mon[32821]: pgmap v381: 260 pgs: 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-06T03:40:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi047-74496-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:08 smithi102 ceph-mon[32821]: osdmap e283: 8 total, 8 up, 8 in 2024-04-06T03:40:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[29365]: osdmap e284: 8 total, 8 up, 8 in 2024-04-06T03:40:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[29365]: osdmap e285: 8 total, 8 up, 8 in 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[37680]: osdmap e284: 8 total, 8 up, 8 in 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[37680]: osdmap e285: 8 total, 8 up, 8 in 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:09 smithi102 ceph-mon[32821]: osdmap e284: 8 total, 8 up, 8 in 2024-04-06T03:40:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi047-74496-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:09.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:09 smithi102 ceph-mon[32821]: osdmap e285: 8 total, 8 up, 8 in 2024-04-06T03:40:09.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:09.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[37680]: pgmap v384: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:40:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[37680]: osdmap e286: 8 total, 8 up, 8 in 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[29365]: pgmap v384: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[29365]: osdmap e286: 8 total, 8 up, 8 in 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:10 smithi102 ceph-mon[32821]: pgmap v384: 260 pgs: 32 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:40:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:10 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:40:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:10 smithi102 ceph-mon[32821]: osdmap e286: 8 total, 8 up, 8 in 2024-04-06T03:40:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:10.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:11.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:11.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:11.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: pgmap v387: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:11.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:11.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]': finished 2024-04-06T03:40:11.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: osdmap e287: 8 total, 8 up, 8 in 2024-04-06T03:40:11.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:11.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]: dispatch 2024-04-06T03:40:11.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:11.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]: dispatch 2024-04-06T03:40:11.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:40:11.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:40:11.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:11.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:11.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: pgmap v387: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]': finished 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: osdmap e287: 8 total, 8 up, 8 in 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]: dispatch 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]: dispatch 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:11.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: pgmap v387: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-39"}]': finished 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: osdmap e287: 8 total, 8 up, 8 in 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]: dispatch 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]: dispatch 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:40:11.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:11 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:40:12.292 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:40:11 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:40:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]': finished 2024-04-06T03:40:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: osdmap e288: 8 total, 8 up, 8 in 2024-04-06T03:40:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:12.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:12.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:12 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]': finished 2024-04-06T03:40:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: osdmap e288: 8 total, 8 up, 8 in 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-39", "mode": "writeback"}]': finished 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: osdmap e288: 8 total, 8 up, 8 in 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3203985677' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]: dispatch 2024-04-06T03:40:12.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:12.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:12.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:12 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:14.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:40:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:40:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: pgmap v390: 260 pgs: 260 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:40:14.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: osdmap e289: 8 total, 8 up, 8 in 2024-04-06T03:40:14.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:14.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:14.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:14.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:14.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi047-74496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:14.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: pgmap v390: 260 pgs: 260 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:14.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:14.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:40:14.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: osdmap e289: 8 total, 8 up, 8 in 2024-04-06T03:40:14.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:14.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:14.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:14.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:14.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi047-74496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: pgmap v390: 260 pgs: 260 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi047-74496-54"}]': finished 2024-04-06T03:40:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:40:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: osdmap e289: 8 total, 8 up, 8 in 2024-04-06T03:40:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]: dispatch 2024-04-06T03:40:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:14.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi047-74496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:15.108 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-04-06T03:40:15.108 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-04-06T03:40:15.108 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-04-06T03:40:15.108 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: seed 74676 2024-04-06T03:40:15.108 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-04-06T03:40:15.108 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (258 ms) 2024-04-06T03:40:15.108 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-04-06T03:40:15.108 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (15154 ms) 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (45 ms) 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (15457 ms total) 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (8655 ms) 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (8027 ms) 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9850 ms) 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-06T03:40:15.109 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: my_snaps [3] 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: my_snaps [4,3] 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: my_snaps [5,4,3] 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: promoting some heads 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: promoting from clones for snap 6 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: promoting from clones for snap 5 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: promoting from clones for snap 4 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: promoting from clones for snap 3 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: waiting for scrubs... 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: done waiting 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46042 ms) 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-06T03:40:15.110 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9983 ms) 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8000 ms) 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8016 ms) 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8018 ms) 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10281 ms) 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8691 ms) 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10018 ms) 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-06T03:40:15.111 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (13249 ms) 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (7738 ms) 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (8010 ms) 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13064 ms) 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7953 ms) 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-06T03:40:15.112 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8269 ms) 2024-04-06T03:40:15.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]': finished 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi047-74496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[37680]: osdmap e290: 8 total, 8 up, 8 in 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi047-74496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]': finished 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi047-74496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[29365]: osdmap e290: 8 total, 8 up, 8 in 2024-04-06T03:40:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi047-74496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:15 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:40:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-39"}]': finished 2024-04-06T03:40:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi047-74496-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:15 smithi102 ceph-mon[32821]: osdmap e290: 8 total, 8 up, 8 in 2024-04-06T03:40:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi047-74496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[29365]: pgmap v393: 260 pgs: 260 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[29365]: osdmap e291: 8 total, 8 up, 8 in 2024-04-06T03:40:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi047-74496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[29365]: osdmap e292: 8 total, 8 up, 8 in 2024-04-06T03:40:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[37680]: pgmap v393: 260 pgs: 260 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[37680]: osdmap e291: 8 total, 8 up, 8 in 2024-04-06T03:40:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi047-74496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[37680]: osdmap e292: 8 total, 8 up, 8 in 2024-04-06T03:40:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:16 smithi102 ceph-mon[32821]: pgmap v393: 260 pgs: 260 active+clean; 4.6 MiB data, 600 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:16 smithi102 ceph-mon[32821]: osdmap e291: 8 total, 8 up, 8 in 2024-04-06T03:40:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:16 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi047-74496-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:16 smithi102 ceph-mon[32821]: osdmap e292: 8 total, 8 up, 8 in 2024-04-06T03:40:16.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:16.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[37680]: pgmap v396: 268 pgs: 40 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[37680]: osdmap e293: 8 total, 8 up, 8 in 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[29365]: pgmap v396: 268 pgs: 40 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[29365]: osdmap e293: 8 total, 8 up, 8 in 2024-04-06T03:40:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:17 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:17 smithi102 ceph-mon[32821]: pgmap v396: 268 pgs: 40 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:40:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:17 smithi102 ceph-mon[32821]: osdmap e293: 8 total, 8 up, 8 in 2024-04-06T03:40:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:17 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: osdmap e294: 8 total, 8 up, 8 in 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: osdmap e295: 8 total, 8 up, 8 in 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: osdmap e294: 8 total, 8 up, 8 in 2024-04-06T03:40:19.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:19.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:19.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:19.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:19.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:19.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:40:19.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: osdmap e295: 8 total, 8 up, 8 in 2024-04-06T03:40:19.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: osdmap e294: 8 total, 8 up, 8 in 2024-04-06T03:40:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:40:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: osdmap e295: 8 total, 8 up, 8 in 2024-04-06T03:40:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]: dispatch 2024-04-06T03:40:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[29365]: pgmap v399: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:40:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[29365]: osdmap e296: 8 total, 8 up, 8 in 2024-04-06T03:40:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:40:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:40:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[37680]: pgmap v399: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:40:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[37680]: osdmap e296: 8 total, 8 up, 8 in 2024-04-06T03:40:20.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:40:20.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:40:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:19 smithi102 ceph-mon[32821]: pgmap v399: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:40:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:20.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1136063058' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi047-74496-55"}]': finished 2024-04-06T03:40:20.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:20.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:19 smithi102 ceph-mon[32821]: osdmap e296: 8 total, 8 up, 8 in 2024-04-06T03:40:20.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:40:20.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:40:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: osdmap e297: 8 total, 8 up, 8 in 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:40:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: osdmap e297: 8 total, 8 up, 8 in 2024-04-06T03:40:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:40:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi047-74496-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: osdmap e297: 8 total, 8 up, 8 in 2024-04-06T03:40:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:22 smithi102 ceph-mon[32821]: pgmap v402: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:22.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:40:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:40:22.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:22 smithi047 ceph-mon[37680]: pgmap v402: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:22.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:22 smithi047 ceph-mon[29365]: pgmap v402: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:23.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: osdmap e298: 8 total, 8 up, 8 in 2024-04-06T03:40:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]: dispatch 2024-04-06T03:40:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]: dispatch 2024-04-06T03:40:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]': finished 2024-04-06T03:40:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[37680]: osdmap e299: 8 total, 8 up, 8 in 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: osdmap e298: 8 total, 8 up, 8 in 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]: dispatch 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]: dispatch 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]': finished 2024-04-06T03:40:23.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-mon[29365]: osdmap e299: 8 total, 8 up, 8 in 2024-04-06T03:40:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: osdmap e298: 8 total, 8 up, 8 in 2024-04-06T03:40:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:23.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]: dispatch 2024-04-06T03:40:23.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]: dispatch 2024-04-06T03:40:23.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi047-74496-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:23.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-41"}]': finished 2024-04-06T03:40:23.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:23 smithi102 ceph-mon[32821]: osdmap e299: 8 total, 8 up, 8 in 2024-04-06T03:40:24.131 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:40:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:40:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:40:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:24 smithi047 ceph-mon[29365]: pgmap v405: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:24 smithi047 ceph-mon[29365]: osdmap e300: 8 total, 8 up, 8 in 2024-04-06T03:40:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:24 smithi047 ceph-mon[37680]: pgmap v405: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:24 smithi047 ceph-mon[37680]: osdmap e300: 8 total, 8 up, 8 in 2024-04-06T03:40:24.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:24 smithi102 ceph-mon[32821]: pgmap v405: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:24.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:24 smithi102 ceph-mon[32821]: osdmap e300: 8 total, 8 up, 8 in 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[29365]: pgmap v408: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[29365]: osdmap e301: 8 total, 8 up, 8 in 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[37680]: pgmap v408: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[37680]: osdmap e301: 8 total, 8 up, 8 in 2024-04-06T03:40:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:26.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:25 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:25 smithi102 ceph-mon[32821]: pgmap v408: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:25 smithi102 ceph-mon[32821]: osdmap e301: 8 total, 8 up, 8 in 2024-04-06T03:40:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:25 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: osdmap e302: 8 total, 8 up, 8 in 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi047-74676-6","var": "pg_num","format": "json"}]: dispatch 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:27.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: osdmap e303: 8 total, 8 up, 8 in 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: osdmap e302: 8 total, 8 up, 8 in 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi047-74676-6","var": "pg_num","format": "json"}]: dispatch 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:27.148 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:27.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:27.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: osdmap e303: 8 total, 8 up, 8 in 2024-04-06T03:40:27.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-06T03:40:27.149 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-06T03:40:27.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:27.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:27.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: osdmap e302: 8 total, 8 up, 8 in 2024-04-06T03:40:27.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2981847761' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:27.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]: dispatch 2024-04-06T03:40:27.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi047-74676-6","var": "pg_num","format": "json"}]: dispatch 2024-04-06T03:40:27.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:27.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:27.238 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi047-74496-56"}]': finished 2024-04-06T03:40:27.238 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:27.238 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: osdmap e303: 8 total, 8 up, 8 in 2024-04-06T03:40:27.238 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-06T03:40:27.238 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-06T03:40:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: pgmap v411: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:28.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:28.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]': finished 2024-04-06T03:40:28.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:28.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: osdmap e304: 8 total, 8 up, 8 in 2024-04-06T03:40:28.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:28.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:28.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: pgmap v411: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:28.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:28.248 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:28.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]': finished 2024-04-06T03:40:28.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:28.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: osdmap e304: 8 total, 8 up, 8 in 2024-04-06T03:40:28.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:28.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:28.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: pgmap v411: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:28.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:28.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_count","val": "8"}]': finished 2024-04-06T03:40:28.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi047-74496-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:28.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: osdmap e304: 8 total, 8 up, 8 in 2024-04-06T03:40:28.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:28.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:28.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:28.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:30.122 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-04-06T03:40:30.122 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: hmm, no HitSet yet 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: ok, hit_set contains 275:602f83fe:::foo:head 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (8762 ms) 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg_num = 32 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 0 ls 1712374830,0 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 1 ls 1712374830,0 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 2 ls 1712374830,0 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 3 ls 1712374830,0 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 4 ls 1712374830,0 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 5 ls 1712374830,0 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 6 ls 1712374830,0 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 7 ls 1712374830,0 2024-04-06T03:40:30.123 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 8 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 9 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 10 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 11 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 12 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 13 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 14 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 15 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 16 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 17 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 18 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 19 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 20 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 21 ls 1712374830,0 2024-04-06T03:40:30.124 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 22 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 23 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 24 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 25 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 26 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 27 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 28 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 29 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 30 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg 31 ls 1712374830,0 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: pg_num = 32 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:6cac518f:::0:head 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:02547ec2:::1:head 2024-04-06T03:40:30.125 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f905c69b:::2:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:cfc208b3:::3:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d83876eb:::4:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b29083e3:::5:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c4fdafeb:::6:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:5c6b0b28:::7:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:bd63b0f1:::8:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:e960b815:::9:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:52ea6a34:::10:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:89d3ae78:::11:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:de5d7c5f:::12:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:566253c9:::13:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:62a1935d:::14:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:863748b0:::15:head 2024-04-06T03:40:30.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:3958e169:::16:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:4d4dabf9:::17:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:8391935d:::18:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:28883081:::19:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:69259c59:::20:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:4bdb80b7:::21:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a11c5d71:::22:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:271af37b:::23:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:95b121be:::24:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:58d1031b:::25:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:0a050783:::26:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c709704c:::27:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:cbe56eaf:::28:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:86b4b162:::29:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:70d89383:::30:head 2024-04-06T03:40:30.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:dd450c7c:::31:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:6d5729b1:::32:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c388f3fb:::33:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:56cfea31:::34:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:9dbc1bf7:::35:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:40b74ccd:::36:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:4d5aaf42:::37:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:920f362c:::38:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:6cc53222:::39:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:9cad833f:::40:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:1ea84d41:::41:head 2024-04-06T03:40:30.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c4480ef6:::42:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a694361e:::43:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d1bd33e9:::44:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:ddc2cd5d:::45:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:2b782207:::46:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:7b187fca:::47:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:90ecdf6f:::48:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a5ed95fe:::49:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:ea0eaa55:::50:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f33ef17b:::51:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a0d1b2f6:::52:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:60c5229e:::53:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:edcbc575:::54:head 2024-04-06T03:40:30.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:102cf253:::55:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:efb7fb0b:::56:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:50d0a326:::57:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d4dc5daf:::58:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:3a130462:::59:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:ec87ed71:::60:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d5bc9454:::61:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:3ddfe313:::62:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:7c2816b9:::63:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:47e00e4d:::64:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c6410c18:::65:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b48ed237:::66:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:cd63ad31:::67:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b179e92b:::68:head 2024-04-06T03:40:30.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:0d9f741a:::69:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:6d3352ae:::70:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c6d5c19e:::71:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:bc4729c3:::72:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:77e930b9:::73:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:0abeecfd:::74:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b7c37e15:::75:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b6378398:::76:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:02bd68de:::77:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:cc795d2d:::78:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:630d4fea:::79:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:e0d29ef5:::80:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:fd6f13d2:::81:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:606461d5:::82:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:eadbdc43:::83:head 2024-04-06T03:40:30.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:8761d0bb:::84:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:9ef0186f:::85:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:e0d41294:::86:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:961de695:::87:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:1423148f:::88:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:633a8fa2:::89:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a8653809:::90:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:3dac8b33:::91:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:35aad435:::92:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f6dcc343:::93:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:dbbdad87:::94:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:1cb48ce0:::95:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:03cd461c:::96:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:17a4ea99:::97:head 2024-04-06T03:40:30.132 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:9993c9a7:::98:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:6394211c:::99:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:94c7ae57:::100:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:6fdee5bb:::101:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:9a477fd1:::102:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:eb850916:::103:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:affc56b9:::104:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b42dc814:::105:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f319f8f0:::106:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:9a40b9de:::107:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:8b524f28:::108:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:e3de589f:::109:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:90f90a5b:::110:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a7b4f1d7:::111:head 2024-04-06T03:40:30.133 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:af51766e:::112:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b6f90bd1:::113:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:e0261208:::114:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c9569ef7:::115:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:61bebe50:::116:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:fe93412b:::117:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d3d38bee:::118:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:3100ba0c:::119:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d0560ada:::120:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f0ea8b35:::121:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:766f231a:::122:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a07a2582:::123:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:bd7c6b3a:::124:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:fb2ddaff:::125:head 2024-04-06T03:40:30.134 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:4408e1fe:::126:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:ee1df7a7:::127:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c3002909:::128:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:4f48ffa9:::129:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:edf38733:::130:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c08425c0:::131:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:5f902d98:::132:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:41ea2c93:::133:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:813cee13:::134:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:0131818d:::135:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:26ba5a85:::136:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:381b8a5a:::137:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:28797e47:::138:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:bfca7f22:::139:head 2024-04-06T03:40:30.135 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:36807075:::140:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:80b03975:::141:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:5c15709b:::142:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f39ea15e:::143:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:ea992956:::144:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:48887b1c:::145:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:9f24a9dd:::146:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:987f100b:::147:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d2dd3581:::148:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:7fed1808:::149:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c80b70e9:::150:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:85ed90f9:::151:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:36428b24:::152:head 2024-04-06T03:40:30.136 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d044c34a:::153:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:7c18bf58:::154:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d1c21232:::155:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a7a3c575:::156:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:87da0633:::157:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d5ac3822:::158:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:3f20522d:::159:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:6ca26563:::160:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:532ce135:::161:head 2024-04-06T03:40:30.137 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:c78863e6:::162:head 2024-04-06T03:40:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[29365]: pgmap v414: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-06T03:40:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[29365]: osdmap e305: 8 total, 8 up, 8 in 2024-04-06T03:40:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-06T03:40:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[37680]: pgmap v414: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-06T03:40:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[37680]: osdmap e305: 8 total, 8 up, 8 in 2024-04-06T03:40:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-06T03:40:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:29 smithi102 ceph-mon[32821]: pgmap v414: 260 pgs: 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-06T03:40:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:29 smithi102 ceph-mon[32821]: osdmap e305: 8 total, 8 up, 8 in 2024-04-06T03:40:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-06T03:40:31.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:31.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-04-06T03:40:31.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: osdmap e306: 8 total, 8 up, 8 in 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi047-74676-43","var": "pg_num","format": "json"}]: dispatch 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]: dispatch 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]: dispatch 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: osdmap e306: 8 total, 8 up, 8 in 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi047-74676-43","var": "pg_num","format": "json"}]: dispatch 2024-04-06T03:40:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:31.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:31.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]: dispatch 2024-04-06T03:40:31.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]: dispatch 2024-04-06T03:40:31.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:30 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi047-74496-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-04-06T03:40:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: osdmap e306: 8 total, 8 up, 8 in 2024-04-06T03:40:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi047-74676-43","var": "pg_num","format": "json"}]: dispatch 2024-04-06T03:40:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]: dispatch 2024-04-06T03:40:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]: dispatch 2024-04-06T03:40:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:30 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:32.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:31 smithi047 ceph-mon[29365]: pgmap v417: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:32.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]': finished 2024-04-06T03:40:32.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:31 smithi047 ceph-mon[29365]: osdmap e307: 8 total, 8 up, 8 in 2024-04-06T03:40:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:31 smithi047 ceph-mon[37680]: pgmap v417: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]': finished 2024-04-06T03:40:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:31 smithi047 ceph-mon[37680]: osdmap e307: 8 total, 8 up, 8 in 2024-04-06T03:40:32.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:40:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:40:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:31 smithi102 ceph-mon[32821]: pgmap v417: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-43"}]': finished 2024-04-06T03:40:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:31 smithi102 ceph-mon[32821]: osdmap e307: 8 total, 8 up, 8 in 2024-04-06T03:40:33.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:32 smithi047 ceph-mon[29365]: osdmap e308: 8 total, 8 up, 8 in 2024-04-06T03:40:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:32 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:32 smithi047 ceph-mon[37680]: osdmap e308: 8 total, 8 up, 8 in 2024-04-06T03:40:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:32 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:33.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:32 smithi102 ceph-mon[32821]: osdmap e308: 8 total, 8 up, 8 in 2024-04-06T03:40:33.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:33.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:33.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:32 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:34.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:40:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:40:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[37680]: pgmap v420: 228 pgs: 228 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[37680]: osdmap e309: 8 total, 8 up, 8 in 2024-04-06T03:40:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[29365]: pgmap v420: 228 pgs: 228 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[29365]: osdmap e309: 8 total, 8 up, 8 in 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:34.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:34.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:34.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:33 smithi102 ceph-mon[32821]: pgmap v420: 228 pgs: 228 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:33 smithi102 ceph-mon[32821]: osdmap e309: 8 total, 8 up, 8 in 2024-04-06T03:40:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2635066872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]: dispatch 2024-04-06T03:40:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:34.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:35.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[37680]: osdmap e310: 8 total, 8 up, 8 in 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi047-74496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[29365]: osdmap e310: 8 total, 8 up, 8 in 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:35.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:35.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:35.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:35.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi047-74496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:35.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi047-74496-57"}]': finished 2024-04-06T03:40:35.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:35.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:34 smithi102 ceph-mon[32821]: osdmap e310: 8 total, 8 up, 8 in 2024-04-06T03:40:35.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:35.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:35.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:35.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:35.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi047-74496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[29365]: pgmap v423: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi047-74496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[29365]: osdmap e311: 8 total, 8 up, 8 in 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi047-74496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[37680]: pgmap v423: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:36.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi047-74496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:36.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[37680]: osdmap e311: 8 total, 8 up, 8 in 2024-04-06T03:40:36.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:40:36.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi047-74496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:36.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:36 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:40:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:36 smithi102 ceph-mon[32821]: pgmap v423: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:36 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:36.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi047-74496-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:36.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:36 smithi102 ceph-mon[32821]: osdmap e311: 8 total, 8 up, 8 in 2024-04-06T03:40:36.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:40:36.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi047-74496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:36.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:36 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]': finished 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: osdmap e312: 8 total, 8 up, 8 in 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: pgmap v426: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi047-74496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]': finished 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: osdmap e313: 8 total, 8 up, 8 in 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:40:37.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]': finished 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: osdmap e312: 8 total, 8 up, 8 in 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: pgmap v426: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi047-74496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]': finished 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: osdmap e313: 8 total, 8 up, 8 in 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:40:37.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:40:37.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_count","val": "3"}]': finished 2024-04-06T03:40:37.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:40:37.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: osdmap e312: 8 total, 8 up, 8 in 2024-04-06T03:40:37.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:40:37.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: pgmap v426: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:37.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi047-74496-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:37.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_period","val": "3"}]': finished 2024-04-06T03:40:37.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: osdmap e313: 8 total, 8 up, 8 in 2024-04-06T03:40:37.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:40:37.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:40:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:40:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:38 smithi047 ceph-mon[29365]: osdmap e314: 8 total, 8 up, 8 in 2024-04-06T03:40:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:40:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:40:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:40:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:38 smithi047 ceph-mon[37680]: osdmap e314: 8 total, 8 up, 8 in 2024-04-06T03:40:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:40:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:40:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:40:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:38 smithi102 ceph-mon[32821]: osdmap e314: 8 total, 8 up, 8 in 2024-04-06T03:40:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:40:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:40:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[29365]: pgmap v429: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[29365]: osdmap e315: 8 total, 8 up, 8 in 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[37680]: pgmap v429: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[37680]: osdmap e315: 8 total, 8 up, 8 in 2024-04-06T03:40:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:39 smithi102 ceph-mon[32821]: pgmap v429: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:39 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-06T03:40:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:39 smithi102 ceph-mon[32821]: osdmap e315: 8 total, 8 up, 8 in 2024-04-06T03:40:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:41.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:41.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:40 smithi047 ceph-mon[29365]: osdmap e316: 8 total, 8 up, 8 in 2024-04-06T03:40:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:40 smithi047 ceph-mon[37680]: osdmap e316: 8 total, 8 up, 8 in 2024-04-06T03:40:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:40 smithi102 ceph-mon[32821]: osdmap e316: 8 total, 8 up, 8 in 2024-04-06T03:40:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]: dispatch 2024-04-06T03:40:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2578525900' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi047-74496-58"}]': finished 2024-04-06T03:40:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[29365]: pgmap v432: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[29365]: osdmap e317: 8 total, 8 up, 8 in 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[37680]: pgmap v432: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[37680]: osdmap e317: 8 total, 8 up, 8 in 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:42.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:42.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:40:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-mon[32821]: pgmap v432: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:42.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-mon[32821]: osdmap e317: 8 total, 8 up, 8 in 2024-04-06T03:40:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[29365]: osdmap e318: 8 total, 8 up, 8 in 2024-04-06T03:40:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[37680]: osdmap e318: 8 total, 8 up, 8 in 2024-04-06T03:40:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:43.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:43.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:43 smithi102 ceph-mon[32821]: osdmap e318: 8 total, 8 up, 8 in 2024-04-06T03:40:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:44.209 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:40:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:40:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:40:44.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:44 smithi047 ceph-mon[29365]: pgmap v435: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-06T03:40:44.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:44 smithi047 ceph-mon[29365]: osdmap e319: 8 total, 8 up, 8 in 2024-04-06T03:40:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:44 smithi047 ceph-mon[29365]: osdmap e320: 8 total, 8 up, 8 in 2024-04-06T03:40:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:44 smithi047 ceph-mon[37680]: pgmap v435: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-06T03:40:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:44 smithi047 ceph-mon[37680]: osdmap e319: 8 total, 8 up, 8 in 2024-04-06T03:40:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:44 smithi047 ceph-mon[37680]: osdmap e320: 8 total, 8 up, 8 in 2024-04-06T03:40:44.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:44 smithi102 ceph-mon[32821]: pgmap v435: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-06T03:40:44.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:44 smithi102 ceph-mon[32821]: osdmap e319: 8 total, 8 up, 8 in 2024-04-06T03:40:44.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi047-74496-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:44.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:44 smithi102 ceph-mon[32821]: osdmap e320: 8 total, 8 up, 8 in 2024-04-06T03:40:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:45 smithi047 ceph-mon[29365]: pgmap v438: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-06T03:40:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:45 smithi047 ceph-mon[29365]: osdmap e321: 8 total, 8 up, 8 in 2024-04-06T03:40:46.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:45 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:45 smithi047 ceph-mon[37680]: pgmap v438: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-06T03:40:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:45 smithi047 ceph-mon[37680]: osdmap e321: 8 total, 8 up, 8 in 2024-04-06T03:40:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:45 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:45 smithi102 ceph-mon[32821]: pgmap v438: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-06T03:40:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:45 smithi102 ceph-mon[32821]: osdmap e321: 8 total, 8 up, 8 in 2024-04-06T03:40:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:45 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:47.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:46 smithi047 ceph-mon[29365]: osdmap e322: 8 total, 8 up, 8 in 2024-04-06T03:40:47.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:47.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:46 smithi047 ceph-mon[37680]: osdmap e322: 8 total, 8 up, 8 in 2024-04-06T03:40:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:46 smithi102 ceph-mon[32821]: osdmap e322: 8 total, 8 up, 8 in 2024-04-06T03:40:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:47.976 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:7462ddf6:::1o.RoundTripAppendPP (3008 ms) 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2989 ms) 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3006 ms) 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3258 ms) 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: setting pool EIO 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: max_success 100, min_failed 101 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (3755 ms) 2024-04-06T03:40:47.977 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3010 ms) 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (130195 ms total) 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3256 ms) 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (8765 ms) 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14970 ms) 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3002 ms) 2024-04-06T03:40:47.978 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29993 ms total) 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3006 ms) 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3006 ms total) 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13991 ms) 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7021 ms) 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6981 ms) 2024-04-06T03:40:47.979 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7025 ms) 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3006 ms) 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7046 ms) 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6926 ms) 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7032 ms) 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7012 ms) 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7013 ms) 2024-04-06T03:40:47.980 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-04-06T03:40:47.981 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7032 ms) 2024-04-06T03:40:47.981 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-04-06T03:40:47.981 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7033 ms) 2024-04-06T03:40:47.981 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-06T03:40:47.981 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7036 ms) 2024-04-06T03:40:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[37680]: pgmap v441: 260 pgs: 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:40:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[37680]: osdmap e323: 8 total, 8 up, 8 in 2024-04-06T03:40:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:48.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[29365]: pgmap v441: 260 pgs: 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:40:48.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:48.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[29365]: osdmap e323: 8 total, 8 up, 8 in 2024-04-06T03:40:48.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:48.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:47 smithi102 ceph-mon[32821]: pgmap v441: 260 pgs: 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:40:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:47 smithi102 ceph-mon[32821]: osdmap e323: 8 total, 8 up, 8 in 2024-04-06T03:40:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/542196965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]: dispatch 2024-04-06T03:40:49.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:49.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:48 smithi047 ceph-mon[29365]: osdmap e324: 8 total, 8 up, 8 in 2024-04-06T03:40:49.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:49.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:49.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:48 smithi047 ceph-mon[37680]: osdmap e324: 8 total, 8 up, 8 in 2024-04-06T03:40:49.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi047-74496-59"}]': finished 2024-04-06T03:40:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:48 smithi102 ceph-mon[32821]: osdmap e324: 8 total, 8 up, 8 in 2024-04-06T03:40:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:40:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:49 smithi047 ceph-mon[29365]: pgmap v444: 260 pgs: 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:40:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:49 smithi047 ceph-mon[29365]: osdmap e325: 8 total, 8 up, 8 in 2024-04-06T03:40:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2291366988' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:49 smithi047 ceph-mon[37680]: pgmap v444: 260 pgs: 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:40:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:49 smithi047 ceph-mon[37680]: osdmap e325: 8 total, 8 up, 8 in 2024-04-06T03:40:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2291366988' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:49 smithi102 ceph-mon[32821]: pgmap v444: 260 pgs: 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-06T03:40:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:49 smithi102 ceph-mon[32821]: osdmap e325: 8 total, 8 up, 8 in 2024-04-06T03:40:50.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2291366988' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2291366988' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:50 smithi102 ceph-mon[32821]: osdmap e326: 8 total, 8 up, 8 in 2024-04-06T03:40:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:50 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]: dispatch 2024-04-06T03:40:51.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]: dispatch 2024-04-06T03:40:51.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2291366988' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[29365]: osdmap e326: 8 total, 8 up, 8 in 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]: dispatch 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]: dispatch 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2291366988' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi047-74496-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[37680]: osdmap e326: 8 total, 8 up, 8 in 2024-04-06T03:40:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:51.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:51.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:40:51.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]: dispatch 2024-04-06T03:40:51.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]: dispatch 2024-04-06T03:40:52.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:40:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:40:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:52 smithi102 ceph-mon[32821]: pgmap v447: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]': finished 2024-04-06T03:40:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:52 smithi102 ceph-mon[32821]: osdmap e327: 8 total, 8 up, 8 in 2024-04-06T03:40:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi047-74496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[29365]: pgmap v447: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]': finished 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[29365]: osdmap e327: 8 total, 8 up, 8 in 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi047-74496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[37680]: pgmap v447: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-45"}]': finished 2024-04-06T03:40:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[37680]: osdmap e327: 8 total, 8 up, 8 in 2024-04-06T03:40:52.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:52.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:52.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi047-74496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi047-74496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:53.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:53 smithi102 ceph-mon[32821]: osdmap e328: 8 total, 8 up, 8 in 2024-04-06T03:40:53.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi047-74496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:53.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:53.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi047-74496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:53.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-mon[29365]: osdmap e328: 8 total, 8 up, 8 in 2024-04-06T03:40:53.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi047-74496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:53.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi047-74496-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-mon[37680]: osdmap e328: 8 total, 8 up, 8 in 2024-04-06T03:40:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi047-74496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:53.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:40:54.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:40:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:40:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:40:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: pgmap v450: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: osdmap e329: 8 total, 8 up, 8 in 2024-04-06T03:40:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi047-74496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: osdmap e330: 8 total, 8 up, 8 in 2024-04-06T03:40:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:54.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: pgmap v450: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: osdmap e329: 8 total, 8 up, 8 in 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi047-74496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: osdmap e330: 8 total, 8 up, 8 in 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: pgmap v450: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:54.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: osdmap e329: 8 total, 8 up, 8 in 2024-04-06T03:40:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:40:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi047-74496-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:40:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: osdmap e330: 8 total, 8 up, 8 in 2024-04-06T03:40:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:54.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:40:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:56 smithi102 ceph-mon[32821]: pgmap v453: 268 pgs: 40 unknown, 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:56 smithi102 ceph-mon[32821]: osdmap e331: 8 total, 8 up, 8 in 2024-04-06T03:40:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:40:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:40:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:56 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:56.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[29365]: pgmap v453: 268 pgs: 40 unknown, 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[29365]: osdmap e331: 8 total, 8 up, 8 in 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[37680]: pgmap v453: 268 pgs: 40 unknown, 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[37680]: osdmap e331: 8 total, 8 up, 8 in 2024-04-06T03:40:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:40:56.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:40:56.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:56 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:40:57.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]': finished 2024-04-06T03:40:57.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:57 smithi102 ceph-mon[32821]: osdmap e332: 8 total, 8 up, 8 in 2024-04-06T03:40:57.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]: dispatch 2024-04-06T03:40:57.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]: dispatch 2024-04-06T03:40:57.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:57.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:57 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:57.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]': finished 2024-04-06T03:40:57.397 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]': finished 2024-04-06T03:40:57.397 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[29365]: osdmap e332: 8 total, 8 up, 8 in 2024-04-06T03:40:57.397 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]: dispatch 2024-04-06T03:40:57.397 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]: dispatch 2024-04-06T03:40:57.397 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:57.397 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:57.397 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]': finished 2024-04-06T03:40:57.398 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-47"}]': finished 2024-04-06T03:40:57.398 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[37680]: osdmap e332: 8 total, 8 up, 8 in 2024-04-06T03:40:57.398 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]: dispatch 2024-04-06T03:40:57.398 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]: dispatch 2024-04-06T03:40:57.398 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:57.398 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:40:57.398 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-47", "mode": "writeback"}]': finished 2024-04-06T03:40:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: pgmap v456: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:40:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: osdmap e333: 8 total, 8 up, 8 in 2024-04-06T03:40:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:40:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:58 smithi102 ceph-mon[32821]: osdmap e334: 8 total, 8 up, 8 in 2024-04-06T03:40:58.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: pgmap v456: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: osdmap e333: 8 total, 8 up, 8 in 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[37680]: osdmap e334: 8 total, 8 up, 8 in 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: pgmap v456: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:40:58.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:58.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: osdmap e333: 8 total, 8 up, 8 in 2024-04-06T03:40:58.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:58.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]: dispatch 2024-04-06T03:40:58.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:40:58.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2935743376' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi047-74496-61"}]': finished 2024-04-06T03:40:58.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:40:58.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:58 smithi047 ceph-mon[29365]: osdmap e334: 8 total, 8 up, 8 in 2024-04-06T03:40:59.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:59.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:59.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:59.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:59.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:59.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:59.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:40:59 smithi102 ceph-mon[32821]: osdmap e335: 8 total, 8 up, 8 in 2024-04-06T03:40:59.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[29365]: osdmap e335: 8 total, 8 up, 8 in 2024-04-06T03:40:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:40:59.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:40:59 smithi047 ceph-mon[37680]: osdmap e335: 8 total, 8 up, 8 in 2024-04-06T03:41:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:00 smithi102 ceph-mon[32821]: pgmap v459: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:41:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:00.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:00.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:00 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:00.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:41:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[29365]: pgmap v459: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:41:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[37680]: pgmap v459: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:00.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:41:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: osdmap e336: 8 total, 8 up, 8 in 2024-04-06T03:41:01.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:01.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: pgmap v462: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:01.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:01.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:01.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:41:01.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: osdmap e337: 8 total, 8 up, 8 in 2024-04-06T03:41:01.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:41:01.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:41:01.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:01.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: osdmap e336: 8 total, 8 up, 8 in 2024-04-06T03:41:01.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:01.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: pgmap v462: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: osdmap e337: 8 total, 8 up, 8 in 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: osdmap e336: 8 total, 8 up, 8 in 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: pgmap v462: 260 pgs: 260 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi047-74496-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:01.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:41:01.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: osdmap e337: 8 total, 8 up, 8 in 2024-04-06T03:41:01.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:41:01.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:41:02.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:41:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:41:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-06T03:41:03.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:03.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:03 smithi102 ceph-mon[32821]: osdmap e338: 8 total, 8 up, 8 in 2024-04-06T03:41:03.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:41:03.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:41:03.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[29365]: osdmap e338: 8 total, 8 up, 8 in 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[37680]: osdmap e338: 8 total, 8 up, 8 in 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:41:04.030 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:41:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:41:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:41:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:04 smithi102 ceph-mon[32821]: pgmap v465: 268 pgs: 8 creating+peering, 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-06T03:41:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:04 smithi102 ceph-mon[32821]: osdmap e339: 8 total, 8 up, 8 in 2024-04-06T03:41:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:04.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[37680]: pgmap v465: 268 pgs: 8 creating+peering, 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[37680]: osdmap e339: 8 total, 8 up, 8 in 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[29365]: pgmap v465: 268 pgs: 8 creating+peering, 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-06T03:41:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[29365]: osdmap e339: 8 total, 8 up, 8 in 2024-04-06T03:41:04.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:04.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:04.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:04.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:04.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: osdmap e340: 8 total, 8 up, 8 in 2024-04-06T03:41:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]': finished 2024-04-06T03:41:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:05 smithi102 ceph-mon[32821]: osdmap e341: 8 total, 8 up, 8 in 2024-04-06T03:41:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: osdmap e340: 8 total, 8 up, 8 in 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]': finished 2024-04-06T03:41:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[29365]: osdmap e341: 8 total, 8 up, 8 in 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: osdmap e340: 8 total, 8 up, 8 in 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/535863255' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]: dispatch 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi047-74496-62"}]': finished 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]': finished 2024-04-06T03:41:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:05 smithi047 ceph-mon[37680]: osdmap e341: 8 total, 8 up, 8 in 2024-04-06T03:41:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: pgmap v468: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:06.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: pgmap v468: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:06.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: pgmap v468: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:06.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-47"}]: dispatch 2024-04-06T03:41:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:07 smithi102 ceph-mon[32821]: osdmap e342: 8 total, 8 up, 8 in 2024-04-06T03:41:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:07.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:07.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:07 smithi047 ceph-mon[29365]: osdmap e342: 8 total, 8 up, 8 in 2024-04-06T03:41:07.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:07.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:07.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi047-74496-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:07.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:07 smithi047 ceph-mon[37680]: osdmap e342: 8 total, 8 up, 8 in 2024-04-06T03:41:07.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:07.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: pgmap v471: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:41:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: osdmap e343: 8 total, 8 up, 8 in 2024-04-06T03:41:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:08.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:08.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:08.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:08.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: osdmap e344: 8 total, 8 up, 8 in 2024-04-06T03:41:08.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:08.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: pgmap v471: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: osdmap e343: 8 total, 8 up, 8 in 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: osdmap e344: 8 total, 8 up, 8 in 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:08.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: pgmap v471: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: osdmap e343: 8 total, 8 up, 8 in 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi047-74496-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: osdmap e344: 8 total, 8 up, 8 in 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:08.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:10 smithi102 ceph-mon[32821]: pgmap v474: 268 pgs: 40 unknown, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:41:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:41:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:10 smithi102 ceph-mon[32821]: osdmap e345: 8 total, 8 up, 8 in 2024-04-06T03:41:10.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:10.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:10.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:10 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:10.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[29365]: pgmap v474: 268 pgs: 40 unknown, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[29365]: osdmap e345: 8 total, 8 up, 8 in 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[37680]: pgmap v474: 268 pgs: 40 unknown, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[37680]: osdmap e345: 8 total, 8 up, 8 in 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:10 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]': finished 2024-04-06T03:41:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:11 smithi102 ceph-mon[32821]: osdmap e346: 8 total, 8 up, 8 in 2024-04-06T03:41:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]: dispatch 2024-04-06T03:41:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]: dispatch 2024-04-06T03:41:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:11 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:11 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:41:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]': finished 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[37680]: osdmap e346: 8 total, 8 up, 8 in 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]: dispatch 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]: dispatch 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-49"}]': finished 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[29365]: osdmap e346: 8 total, 8 up, 8 in 2024-04-06T03:41:11.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]: dispatch 2024-04-06T03:41:11.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:11.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]: dispatch 2024-04-06T03:41:11.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:11.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:11 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:41:12.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:41:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: pgmap v477: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:12.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:41:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]': finished 2024-04-06T03:41:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: osdmap e347: 8 total, 8 up, 8 in 2024-04-06T03:41:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:41:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:41:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:12 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:12.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: pgmap v477: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]': finished 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: osdmap e347: 8 total, 8 up, 8 in 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: pgmap v477: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-49", "mode": "readproxy"}]': finished 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: osdmap e347: 8 total, 8 up, 8 in 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/969487025' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]: dispatch 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:41:12.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:12 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:13 smithi102 ceph-mon[32821]: osdmap e348: 8 total, 8 up, 8 in 2024-04-06T03:41:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi047-74496-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:13.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[29365]: osdmap e348: 8 total, 8 up, 8 in 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi047-74496-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi047-74496-63"}]': finished 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[37680]: osdmap e348: 8 total, 8 up, 8 in 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi047-74496-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:14.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:41:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:41:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:41:14.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:14 smithi047 ceph-mon[29365]: pgmap v480: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:14.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi047-74496-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:14.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:14 smithi047 ceph-mon[29365]: osdmap e349: 8 total, 8 up, 8 in 2024-04-06T03:41:14.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi047-74496-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:14.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:14 smithi047 ceph-mon[37680]: pgmap v480: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:14.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi047-74496-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:14.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:14 smithi047 ceph-mon[37680]: osdmap e349: 8 total, 8 up, 8 in 2024-04-06T03:41:14.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi047-74496-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:14.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:14 smithi102 ceph-mon[32821]: pgmap v480: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:14.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi047-74496-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:14.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:14 smithi102 ceph-mon[32821]: osdmap e349: 8 total, 8 up, 8 in 2024-04-06T03:41:14.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi047-74496-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:15.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:15 smithi047 ceph-mon[37680]: osdmap e350: 8 total, 8 up, 8 in 2024-04-06T03:41:15.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:15 smithi047 ceph-mon[37680]: pgmap v483: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:15.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi047-74496-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:15.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:15 smithi047 ceph-mon[37680]: osdmap e351: 8 total, 8 up, 8 in 2024-04-06T03:41:15.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:15 smithi047 ceph-mon[29365]: osdmap e350: 8 total, 8 up, 8 in 2024-04-06T03:41:15.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:15 smithi047 ceph-mon[29365]: pgmap v483: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:15.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi047-74496-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:15.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:15 smithi047 ceph-mon[29365]: osdmap e351: 8 total, 8 up, 8 in 2024-04-06T03:41:15.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:15 smithi102 ceph-mon[32821]: osdmap e350: 8 total, 8 up, 8 in 2024-04-06T03:41:15.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:15 smithi102 ceph-mon[32821]: pgmap v483: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:15.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi047-74496-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:15.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:15 smithi102 ceph-mon[32821]: osdmap e351: 8 total, 8 up, 8 in 2024-04-06T03:41:16.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:16 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:16.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:16 smithi047 ceph-mon[29365]: osdmap e352: 8 total, 8 up, 8 in 2024-04-06T03:41:16.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:16 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:16.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:16 smithi047 ceph-mon[37680]: osdmap e352: 8 total, 8 up, 8 in 2024-04-06T03:41:16.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:16 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:16.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:16 smithi102 ceph-mon[32821]: osdmap e352: 8 total, 8 up, 8 in 2024-04-06T03:41:18.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:18 smithi047 ceph-mon[37680]: pgmap v486: 268 pgs: 268 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:18 smithi047 ceph-mon[37680]: osdmap e353: 8 total, 8 up, 8 in 2024-04-06T03:41:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:18 smithi047 ceph-mon[29365]: pgmap v486: 268 pgs: 268 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:18 smithi047 ceph-mon[29365]: osdmap e353: 8 total, 8 up, 8 in 2024-04-06T03:41:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:18 smithi102 ceph-mon[32821]: pgmap v486: 268 pgs: 268 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:41:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:18 smithi102 ceph-mon[32821]: osdmap e353: 8 total, 8 up, 8 in 2024-04-06T03:41:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:19.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[37680]: osdmap e354: 8 total, 8 up, 8 in 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[37680]: osdmap e355: 8 total, 8 up, 8 in 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[29365]: osdmap e354: 8 total, 8 up, 8 in 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:19.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:19.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:19.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:19.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:19 smithi047 ceph-mon[29365]: osdmap e355: 8 total, 8 up, 8 in 2024-04-06T03:41:19.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:19.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:19 smithi102 ceph-mon[32821]: osdmap e354: 8 total, 8 up, 8 in 2024-04-06T03:41:19.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]: dispatch 2024-04-06T03:41:19.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:19.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:19.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2328328365' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi047-74496-64"}]': finished 2024-04-06T03:41:19.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:19 smithi102 ceph-mon[32821]: osdmap e355: 8 total, 8 up, 8 in 2024-04-06T03:41:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[37680]: pgmap v489: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[29365]: pgmap v489: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:20.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:20 smithi102 ceph-mon[32821]: pgmap v489: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:20.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:20.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:21.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:21.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:21 smithi047 ceph-mon[29365]: osdmap e356: 8 total, 8 up, 8 in 2024-04-06T03:41:21.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:21.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:21.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:21.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:21 smithi047 ceph-mon[37680]: osdmap e356: 8 total, 8 up, 8 in 2024-04-06T03:41:21.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:21.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi047-74496-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:21 smithi102 ceph-mon[32821]: osdmap e356: 8 total, 8 up, 8 in 2024-04-06T03:41:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:21.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:22.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:41:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:41:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:22 smithi102 ceph-mon[32821]: pgmap v492: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:22 smithi102 ceph-mon[32821]: osdmap e357: 8 total, 8 up, 8 in 2024-04-06T03:41:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:22.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:22.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:22 smithi047 ceph-mon[37680]: pgmap v492: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:22.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:22 smithi047 ceph-mon[37680]: osdmap e357: 8 total, 8 up, 8 in 2024-04-06T03:41:22.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:22.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:22 smithi047 ceph-mon[29365]: pgmap v492: 260 pgs: 260 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:22 smithi047 ceph-mon[29365]: osdmap e357: 8 total, 8 up, 8 in 2024-04-06T03:41:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[29365]: osdmap e358: 8 total, 8 up, 8 in 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[37680]: osdmap e358: 8 total, 8 up, 8 in 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi047-74496-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:23.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:23 smithi102 ceph-mon[32821]: osdmap e358: 8 total, 8 up, 8 in 2024-04-06T03:41:23.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:23.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:24.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP63:head 2024-04-06T03:41:24.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:5d165639:::164:head 2024-04-06T03:41:24.126 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f43765fc:::165:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b4c720e9:::166:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:e694b040:::167:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:afa38db2:::168:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:77ba9f53:::169:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:87495034:::170:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:7c96bf0e:::171:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:dbe346cc:::172:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:e943ec24:::173:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f97a9c0c:::174:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:6f26e74d:::175:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:4f95e106:::176:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:0e6f2f8f:::177:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:05db05f1:::178:head 2024-04-06T03:41:24.127 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:38a78d66:::179:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:d095610b:::180:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:a1a9d709:::181:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:1e5d39db:::182:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:f7df4fb9:::183:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:03a7f161:::184:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:ba70721e:::185:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:28e5662d:::186:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:973d52de:::187:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:4303eb1c:::188:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:b990b48e:::189:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:29b8165b:::190:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:3547f197:::191:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:7e260936:::192:head 2024-04-06T03:41:24.128 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:1abec7b1:::193:head 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:10fdda93:::194:head 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:15817eea:::195:head 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:770bab57:::196:head 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:ed9e13e7:::197:head 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:71471a8f:::198:head 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: checking for 277:10fb1d02:::199:head 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8027 ms) 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,0 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: first is 1712374839 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,0 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,0 2024-04-06T03:41:24.129 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,1712374844,1712374845,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,1712374844,1712374845,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,1712374844,1712374845,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,1712374844,1712374845,1712374847,1712374848,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,1712374844,1712374845,1712374847,1712374848,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374839,1712374841,1712374842,1712374844,1712374845,1712374847,1712374848,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712374842,1712374844,1712374845,1712374847,1712374848,1712374850,1712374851,0 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: first now 1712374842, trimmed 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (20106 ms) 2024-04-06T03:41:24.130 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-06T03:41:24.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: foo0 2024-04-06T03:41:24.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-04-06T03:41:24.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14044 ms) 2024-04-06T03:41:24.131 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-04-06T03:41:24.131 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:41:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:41:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:41:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: pgmap v495: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]': finished 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: osdmap e359: 8 total, 8 up, 8 in 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: pgmap v495: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]': finished 2024-04-06T03:41:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: osdmap e359: 8 total, 8 up, 8 in 2024-04-06T03:41:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:24.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:24.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: pgmap v495: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:24.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:24.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:24.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]': finished 2024-04-06T03:41:24.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: osdmap e359: 8 total, 8 up, 8 in 2024-04-06T03:41:24.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:24.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:24.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:24.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-49"}]: dispatch 2024-04-06T03:41:25.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:25 smithi047 ceph-mon[29365]: osdmap e360: 8 total, 8 up, 8 in 2024-04-06T03:41:25.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:25.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:25.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:25 smithi047 ceph-mon[37680]: osdmap e360: 8 total, 8 up, 8 in 2024-04-06T03:41:25.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:25.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:25.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:25 smithi102 ceph-mon[32821]: osdmap e360: 8 total, 8 up, 8 in 2024-04-06T03:41:25.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:25.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:26.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[29365]: pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[29365]: osdmap e361: 8 total, 8 up, 8 in 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[37680]: pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[37680]: osdmap e361: 8 total, 8 up, 8 in 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:26.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:26.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:26.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:26 smithi102 ceph-mon[32821]: pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:41:26.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:26.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:26 smithi102 ceph-mon[32821]: osdmap e361: 8 total, 8 up, 8 in 2024-04-06T03:41:26.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2191775851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:26.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]: dispatch 2024-04-06T03:41:26.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:26.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:27.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:27.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:27.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: osdmap e362: 8 total, 8 up, 8 in 2024-04-06T03:41:27.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:27.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:27.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.488 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.488 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.488 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.488 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:27.488 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:27.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:27.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:27.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: osdmap e362: 8 total, 8 up, 8 in 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi047-74496-65"}]': finished 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:27.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: osdmap e362: 8 total, 8 up, 8 in 2024-04-06T03:41:27.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:27.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:41:27.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:27.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:27.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:41:28.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[29365]: pgmap v501: 260 pgs: 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[29365]: osdmap e363: 8 total, 8 up, 8 in 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[37680]: pgmap v501: 260 pgs: 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[37680]: osdmap e363: 8 total, 8 up, 8 in 2024-04-06T03:41:28.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:28.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:28.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:28.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:28.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:28 smithi102 ceph-mon[32821]: pgmap v501: 260 pgs: 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:41:28.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:41:28.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi047-74496-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:41:28.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:28 smithi102 ceph-mon[32821]: osdmap e363: 8 total, 8 up, 8 in 2024-04-06T03:41:28.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:28.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:28.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:28.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]': finished 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]: dispatch 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: osdmap e364: 8 total, 8 up, 8 in 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]: dispatch 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: pgmap v504: 260 pgs: 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]': finished 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: osdmap e365: 8 total, 8 up, 8 in 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:41:29.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]': finished 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]: dispatch 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: osdmap e364: 8 total, 8 up, 8 in 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]: dispatch 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: pgmap v504: 260 pgs: 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]': finished 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: osdmap e365: 8 total, 8 up, 8 in 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:41:29.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:41:29.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-51"}]': finished 2024-04-06T03:41:29.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]: dispatch 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: osdmap e364: 8 total, 8 up, 8 in 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]: dispatch 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: pgmap v504: 260 pgs: 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi047-74496-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-51", "mode": "writeback"}]': finished 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: osdmap e365: 8 total, 8 up, 8 in 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:41:29.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:41:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:41:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[29365]: osdmap e366: 8 total, 8 up, 8 in 2024-04-06T03:41:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:41:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:41:31.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:41:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[37680]: osdmap e366: 8 total, 8 up, 8 in 2024-04-06T03:41:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:41:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:41:31.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:31 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:41:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:31 smithi102 ceph-mon[32821]: osdmap e366: 8 total, 8 up, 8 in 2024-04-06T03:41:31.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:41:31.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:41:31.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:31 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:32.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:41:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:41:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:32 smithi102 ceph-mon[32821]: pgmap v507: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:32.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:41:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:32 smithi102 ceph-mon[32821]: osdmap e367: 8 total, 8 up, 8 in 2024-04-06T03:41:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[37680]: pgmap v507: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[37680]: osdmap e367: 8 total, 8 up, 8 in 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[29365]: pgmap v507: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[29365]: osdmap e367: 8 total, 8 up, 8 in 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:41:32.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:32.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ 2 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3026 ms) 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7012 ms) 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7017 ms) 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7043 ms) 2024-04-06T03:41:33.177 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7019 ms) 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7051 ms) 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7027 ms) 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139351 ms total) 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (302545 ms total) 2024-04-06T03:41:33.178 INFO:tasks.workunit.client.0.smithi047.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-04-06T03:41:33.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: osdmap e368: 8 total, 8 up, 8 in 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: osdmap e369: 8 total, 8 up, 8 in 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: osdmap e368: 8 total, 8 up, 8 in 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:33.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:33.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:33.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:41:33.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: osdmap e369: 8 total, 8 up, 8 in 2024-04-06T03:41:33.497 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:41:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: osdmap e368: 8 total, 8 up, 8 in 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3307053392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]: dispatch 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi047-74496-66"}]': finished 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: osdmap e369: 8 total, 8 up, 8 in 2024-04-06T03:41:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:41:34.179 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:41:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:41:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:41:34.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[29365]: pgmap v510: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]': finished 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[29365]: osdmap e370: 8 total, 8 up, 8 in 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[37680]: pgmap v510: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]': finished 2024-04-06T03:41:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:34 smithi047 ceph-mon[37680]: osdmap e370: 8 total, 8 up, 8 in 2024-04-06T03:41:34.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:34 smithi102 ceph-mon[32821]: pgmap v510: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-06T03:41:34.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:41:34.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:41:34.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:34.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-51","var": "target_max_objects","val": "1"}]': finished 2024-04-06T03:41:34.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:34 smithi102 ceph-mon[32821]: osdmap e370: 8 total, 8 up, 8 in 2024-04-06T03:41:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:35 smithi047 ceph-mon[29365]: pgmap v513: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-06T03:41:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:35 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-06T03:41:35.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:35 smithi047 ceph-mon[37680]: pgmap v513: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-06T03:41:35.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:35 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-06T03:41:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:35 smithi102 ceph-mon[32821]: pgmap v513: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-06T03:41:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:35 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-06T03:41:37.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:37 smithi102 ceph-mon[32821]: pgmap v514: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:41:37.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:37 smithi047 ceph-mon[29365]: pgmap v514: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:41:37.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:37 smithi047 ceph-mon[37680]: pgmap v514: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-06T03:41:39.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:39 smithi102 ceph-mon[32821]: pgmap v515: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:39 smithi047 ceph-mon[29365]: pgmap v515: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:39.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:39 smithi047 ceph-mon[37680]: pgmap v515: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:41.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:41 smithi102 ceph-mon[32821]: pgmap v516: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-04-06T03:41:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:41 smithi047 ceph-mon[29365]: pgmap v516: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-04-06T03:41:41.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:41 smithi047 ceph-mon[37680]: pgmap v516: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-04-06T03:41:42.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:41:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:41:42.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:42 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:42.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:42 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:42.998 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:42 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:43.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:43 smithi102 ceph-mon[32821]: pgmap v517: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:43 smithi047 ceph-mon[29365]: pgmap v517: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:43 smithi047 ceph-mon[37680]: pgmap v517: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:43.995 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:41:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:41:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:41:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:44.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:44.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:45 smithi102 ceph-mon[32821]: pgmap v518: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 994 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:45.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:45 smithi102 ceph-mon[32821]: osdmap e371: 8 total, 8 up, 8 in 2024-04-06T03:41:45.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:45.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[37680]: pgmap v518: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 994 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[37680]: osdmap e371: 8 total, 8 up, 8 in 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[29365]: pgmap v518: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 994 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[29365]: osdmap e371: 8 total, 8 up, 8 in 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:45.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]': finished 2024-04-06T03:41:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:46 smithi102 ceph-mon[32821]: osdmap e372: 8 total, 8 up, 8 in 2024-04-06T03:41:46.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:46.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:46.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:46.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]': finished 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[29365]: osdmap e372: 8 total, 8 up, 8 in 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]': finished 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[37680]: osdmap e372: 8 total, 8 up, 8 in 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:46.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-51"}]: dispatch 2024-04-06T03:41:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:47 smithi102 ceph-mon[32821]: pgmap v521: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:47 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-06T03:41:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:47 smithi102 ceph-mon[32821]: osdmap e373: 8 total, 8 up, 8 in 2024-04-06T03:41:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:47 smithi047 ceph-mon[29365]: pgmap v521: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:47 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-06T03:41:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:47 smithi047 ceph-mon[29365]: osdmap e373: 8 total, 8 up, 8 in 2024-04-06T03:41:47.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:47 smithi047 ceph-mon[37680]: pgmap v521: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:41:47.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:47 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-06T03:41:47.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:47 smithi047 ceph-mon[37680]: osdmap e373: 8 total, 8 up, 8 in 2024-04-06T03:41:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:48 smithi102 ceph-mon[32821]: osdmap e374: 8 total, 8 up, 8 in 2024-04-06T03:41:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:48.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:48.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:48 smithi047 ceph-mon[29365]: osdmap e374: 8 total, 8 up, 8 in 2024-04-06T03:41:48.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:48.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:48.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:48 smithi047 ceph-mon[37680]: osdmap e374: 8 total, 8 up, 8 in 2024-04-06T03:41:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:41:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:49 smithi102 ceph-mon[32821]: pgmap v524: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:41:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:49 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:49 smithi102 ceph-mon[32821]: osdmap e375: 8 total, 8 up, 8 in 2024-04-06T03:41:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-53"}]: dispatch 2024-04-06T03:41:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-53"}]: dispatch 2024-04-06T03:41:49.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[29365]: pgmap v524: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:41:49.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[29365]: osdmap e375: 8 total, 8 up, 8 in 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-53"}]: dispatch 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-53"}]: dispatch 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[37680]: pgmap v524: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[37680]: osdmap e375: 8 total, 8 up, 8 in 2024-04-06T03:41:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:49.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:49.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-53"}]: dispatch 2024-04-06T03:41:49.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-53"}]: dispatch 2024-04-06T03:41:50.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:50 smithi102 ceph-mon[32821]: osdmap e376: 8 total, 8 up, 8 in 2024-04-06T03:41:50.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:50 smithi047 ceph-mon[29365]: osdmap e376: 8 total, 8 up, 8 in 2024-04-06T03:41:50.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:50 smithi047 ceph-mon[37680]: osdmap e376: 8 total, 8 up, 8 in 2024-04-06T03:41:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:51 smithi047 ceph-mon[29365]: pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:51 smithi047 ceph-mon[29365]: osdmap e377: 8 total, 8 up, 8 in 2024-04-06T03:41:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:51 smithi047 ceph-mon[37680]: pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:51 smithi047 ceph-mon[37680]: osdmap e377: 8 total, 8 up, 8 in 2024-04-06T03:41:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:52.060 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:51 smithi102 ceph-mon[32821]: pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:41:52.060 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:51 smithi102 ceph-mon[32821]: osdmap e377: 8 total, 8 up, 8 in 2024-04-06T03:41:52.060 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:52.060 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:52.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:41:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[37680]: osdmap e378: 8 total, 8 up, 8 in 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-55"}]: dispatch 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-55"}]: dispatch 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[29365]: osdmap e378: 8 total, 8 up, 8 in 2024-04-06T03:41:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:41:53.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:53.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:53.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-55"}]: dispatch 2024-04-06T03:41:53.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-55"}]: dispatch 2024-04-06T03:41:53.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:52 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:53.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:53.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-mon[32821]: osdmap e378: 8 total, 8 up, 8 in 2024-04-06T03:41:53.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:41:53.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:53.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:53.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-55"}]: dispatch 2024-04-06T03:41:53.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-55"}]: dispatch 2024-04-06T03:41:53.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:52 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:41:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[29365]: pgmap v530: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[29365]: osdmap e379: 8 total, 8 up, 8 in 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[29365]: osdmap e380: 8 total, 8 up, 8 in 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[37680]: pgmap v530: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[37680]: osdmap e379: 8 total, 8 up, 8 in 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[37680]: osdmap e380: 8 total, 8 up, 8 in 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:54.246 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:41:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:41:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:41:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:53 smithi102 ceph-mon[32821]: pgmap v530: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:41:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:53 smithi102 ceph-mon[32821]: osdmap e379: 8 total, 8 up, 8 in 2024-04-06T03:41:54.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:53 smithi102 ceph-mon[32821]: osdmap e380: 8 total, 8 up, 8 in 2024-04-06T03:41:54.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:54.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[37680]: pgmap v533: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[37680]: osdmap e381: 8 total, 8 up, 8 in 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-57"}]: dispatch 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-57"}]: dispatch 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[29365]: pgmap v533: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:56.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[29365]: osdmap e381: 8 total, 8 up, 8 in 2024-04-06T03:41:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-57"}]: dispatch 2024-04-06T03:41:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-57"}]: dispatch 2024-04-06T03:41:56.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:55 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:55 smithi102 ceph-mon[32821]: pgmap v533: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:41:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:55 smithi102 ceph-mon[32821]: osdmap e381: 8 total, 8 up, 8 in 2024-04-06T03:41:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-57"}]: dispatch 2024-04-06T03:41:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-57"}]: dispatch 2024-04-06T03:41:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:55 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:41:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:56 smithi047 ceph-mon[29365]: osdmap e382: 8 total, 8 up, 8 in 2024-04-06T03:41:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:56 smithi047 ceph-mon[29365]: osdmap e383: 8 total, 8 up, 8 in 2024-04-06T03:41:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:57.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:57.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:56 smithi047 ceph-mon[37680]: osdmap e382: 8 total, 8 up, 8 in 2024-04-06T03:41:57.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:56 smithi047 ceph-mon[37680]: osdmap e383: 8 total, 8 up, 8 in 2024-04-06T03:41:57.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:57.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:56 smithi102 ceph-mon[32821]: osdmap e382: 8 total, 8 up, 8 in 2024-04-06T03:41:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:56 smithi102 ceph-mon[32821]: osdmap e383: 8 total, 8 up, 8 in 2024-04-06T03:41:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:57.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[37680]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[37680]: osdmap e384: 8 total, 8 up, 8 in 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-59"}]: dispatch 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-59"}]: dispatch 2024-04-06T03:41:58.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[29365]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:41:58.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:58.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[29365]: osdmap e384: 8 total, 8 up, 8 in 2024-04-06T03:41:58.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:41:58.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:58.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:58.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-59"}]: dispatch 2024-04-06T03:41:58.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-59"}]: dispatch 2024-04-06T03:41:58.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:57 smithi102 ceph-mon[32821]: pgmap v536: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:41:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:41:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:57 smithi102 ceph-mon[32821]: osdmap e384: 8 total, 8 up, 8 in 2024-04-06T03:41:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:41:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:41:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-59"}]: dispatch 2024-04-06T03:41:58.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-59"}]: dispatch 2024-04-06T03:41:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:59 smithi047 ceph-mon[29365]: pgmap v539: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:41:59.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:41:59 smithi047 ceph-mon[29365]: osdmap e385: 8 total, 8 up, 8 in 2024-04-06T03:41:59.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:59 smithi047 ceph-mon[37680]: pgmap v539: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:41:59.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:41:59 smithi047 ceph-mon[37680]: osdmap e385: 8 total, 8 up, 8 in 2024-04-06T03:42:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:59 smithi102 ceph-mon[32821]: pgmap v539: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:42:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:41:59 smithi102 ceph-mon[32821]: osdmap e385: 8 total, 8 up, 8 in 2024-04-06T03:42:00.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:00 smithi047 ceph-mon[29365]: osdmap e386: 8 total, 8 up, 8 in 2024-04-06T03:42:00.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:00.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:00.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:00 smithi047 ceph-mon[37680]: osdmap e386: 8 total, 8 up, 8 in 2024-04-06T03:42:00.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:00.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:00 smithi102 ceph-mon[32821]: osdmap e386: 8 total, 8 up, 8 in 2024-04-06T03:42:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: pgmap v542: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: osdmap e387: 8 total, 8 up, 8 in 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[29365]: osdmap e388: 8 total, 8 up, 8 in 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: pgmap v542: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: osdmap e387: 8 total, 8 up, 8 in 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:01.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:01 smithi047 ceph-mon[37680]: osdmap e388: 8 total, 8 up, 8 in 2024-04-06T03:42:02.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: pgmap v542: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:02.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:02.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: osdmap e387: 8 total, 8 up, 8 in 2024-04-06T03:42:02.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:02.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:02.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:02.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:02.071 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:02.072 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:01 smithi102 ceph-mon[32821]: osdmap e388: 8 total, 8 up, 8 in 2024-04-06T03:42:02.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:42:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:42:02.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-61"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-61"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-61"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-61"}]: dispatch 2024-04-06T03:42:02.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:02 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-61"}]: dispatch 2024-04-06T03:42:03.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-61"}]: dispatch 2024-04-06T03:42:03.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:02 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:03.994 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:42:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:42:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:42:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:03 smithi047 ceph-mon[29365]: pgmap v545: 260 pgs: 260 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:42:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:03 smithi047 ceph-mon[29365]: osdmap e389: 8 total, 8 up, 8 in 2024-04-06T03:42:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:03.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:03 smithi047 ceph-mon[37680]: pgmap v545: 260 pgs: 260 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:42:03.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:03 smithi047 ceph-mon[37680]: osdmap e389: 8 total, 8 up, 8 in 2024-04-06T03:42:03.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:03 smithi102 ceph-mon[32821]: pgmap v545: 260 pgs: 260 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:42:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:03 smithi102 ceph-mon[32821]: osdmap e389: 8 total, 8 up, 8 in 2024-04-06T03:42:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:04.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:04 smithi047 ceph-mon[29365]: osdmap e390: 8 total, 8 up, 8 in 2024-04-06T03:42:04.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:04.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:04.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:04 smithi047 ceph-mon[37680]: osdmap e390: 8 total, 8 up, 8 in 2024-04-06T03:42:04.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:04.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:04 smithi102 ceph-mon[32821]: osdmap e390: 8 total, 8 up, 8 in 2024-04-06T03:42:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:05.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[29365]: pgmap v548: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:42:05.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:05.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[29365]: osdmap e391: 8 total, 8 up, 8 in 2024-04-06T03:42:05.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:05.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:05.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:05.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[37680]: pgmap v548: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:42:05.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:05.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[37680]: osdmap e391: 8 total, 8 up, 8 in 2024-04-06T03:42:05.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:05.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:05.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:05 smithi102 ceph-mon[32821]: pgmap v548: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:42:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:05 smithi102 ceph-mon[32821]: osdmap e391: 8 total, 8 up, 8 in 2024-04-06T03:42:06.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:06.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:06.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:06.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:06.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:06 smithi047 ceph-mon[29365]: osdmap e392: 8 total, 8 up, 8 in 2024-04-06T03:42:06.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:06.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:06 smithi047 ceph-mon[37680]: osdmap e392: 8 total, 8 up, 8 in 2024-04-06T03:42:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:06 smithi102 ceph-mon[32821]: osdmap e392: 8 total, 8 up, 8 in 2024-04-06T03:42:07.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:07 smithi047 ceph-mon[29365]: pgmap v551: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:42:07.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:07 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:07.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:07 smithi047 ceph-mon[29365]: osdmap e393: 8 total, 8 up, 8 in 2024-04-06T03:42:07.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:07 smithi047 ceph-mon[37680]: pgmap v551: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:42:07.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:07 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:07.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:07 smithi047 ceph-mon[37680]: osdmap e393: 8 total, 8 up, 8 in 2024-04-06T03:42:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:07 smithi102 ceph-mon[32821]: pgmap v551: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:42:08.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:07 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:08.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:07 smithi102 ceph-mon[32821]: osdmap e393: 8 total, 8 up, 8 in 2024-04-06T03:42:08.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:08 smithi047 ceph-mon[29365]: osdmap e394: 8 total, 8 up, 8 in 2024-04-06T03:42:08.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:08 smithi047 ceph-mon[37680]: osdmap e394: 8 total, 8 up, 8 in 2024-04-06T03:42:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:08 smithi102 ceph-mon[32821]: osdmap e394: 8 total, 8 up, 8 in 2024-04-06T03:42:09.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:09 smithi047 ceph-mon[29365]: pgmap v554: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:42:09.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:09 smithi047 ceph-mon[29365]: osdmap e395: 8 total, 8 up, 8 in 2024-04-06T03:42:09.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:09 smithi047 ceph-mon[37680]: pgmap v554: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:42:09.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:09 smithi047 ceph-mon[37680]: osdmap e395: 8 total, 8 up, 8 in 2024-04-06T03:42:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:09 smithi102 ceph-mon[32821]: pgmap v554: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:42:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:09 smithi102 ceph-mon[32821]: osdmap e395: 8 total, 8 up, 8 in 2024-04-06T03:42:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:10 smithi047 ceph-mon[29365]: osdmap e396: 8 total, 8 up, 8 in 2024-04-06T03:42:10.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:10 smithi047 ceph-mon[37680]: osdmap e396: 8 total, 8 up, 8 in 2024-04-06T03:42:11.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:10 smithi102 ceph-mon[32821]: osdmap e396: 8 total, 8 up, 8 in 2024-04-06T03:42:11.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:11 smithi047 ceph-mon[29365]: pgmap v557: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:11.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:11 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:42:11.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:11 smithi047 ceph-mon[37680]: pgmap v557: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:11.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:11 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:42:12.082 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:11 smithi102 ceph-mon[32821]: pgmap v557: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:12.082 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:11 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:42:12.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:42:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:42:12.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:12 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:12.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:12 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:42:12.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:12 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:42:12.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:12 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:42:12.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:12 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:12.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:12 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:42:12.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:12 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:42:12.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:12 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:42:13.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:12 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:13.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:12 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:42:13.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:12 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:42:13.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:12 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:42:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:13 smithi047 ceph-mon[29365]: pgmap v558: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-04-06T03:42:13.995 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:42:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:42:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:42:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:13 smithi047 ceph-mon[37680]: pgmap v558: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-04-06T03:42:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:13 smithi102 ceph-mon[32821]: pgmap v558: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-04-06T03:42:15.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:15 smithi047 ceph-mon[29365]: pgmap v559: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 903 B/s wr, 3 op/s 2024-04-06T03:42:15.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:15 smithi047 ceph-mon[37680]: pgmap v559: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 903 B/s wr, 3 op/s 2024-04-06T03:42:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:15 smithi102 ceph-mon[32821]: pgmap v559: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 903 B/s wr, 3 op/s 2024-04-06T03:42:17.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:16 smithi047 ceph-mon[29365]: osdmap e397: 8 total, 8 up, 8 in 2024-04-06T03:42:17.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:16 smithi047 ceph-mon[37680]: osdmap e397: 8 total, 8 up, 8 in 2024-04-06T03:42:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:16 smithi102 ceph-mon[32821]: osdmap e397: 8 total, 8 up, 8 in 2024-04-06T03:42:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:17 smithi047 ceph-mon[29365]: pgmap v561: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 788 B/s wr, 3 op/s 2024-04-06T03:42:18.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:17 smithi047 ceph-mon[37680]: pgmap v561: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 788 B/s wr, 3 op/s 2024-04-06T03:42:18.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:17 smithi102 ceph-mon[32821]: pgmap v561: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 788 B/s wr, 3 op/s 2024-04-06T03:42:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:19 smithi047 ceph-mon[29365]: pgmap v562: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 698 B/s wr, 2 op/s 2024-04-06T03:42:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:19 smithi047 ceph-mon[37680]: pgmap v562: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 698 B/s wr, 2 op/s 2024-04-06T03:42:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:19 smithi102 ceph-mon[32821]: pgmap v562: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 698 B/s wr, 2 op/s 2024-04-06T03:42:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:20 smithi047 ceph-mon[29365]: osdmap e398: 8 total, 8 up, 8 in 2024-04-06T03:42:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:20 smithi047 ceph-mon[37680]: osdmap e398: 8 total, 8 up, 8 in 2024-04-06T03:42:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:20 smithi102 ceph-mon[32821]: osdmap e398: 8 total, 8 up, 8 in 2024-04-06T03:42:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:21 smithi047 ceph-mon[29365]: pgmap v564: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:42:22.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:21 smithi047 ceph-mon[37680]: pgmap v564: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:42:22.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:21 smithi102 ceph-mon[32821]: pgmap v564: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:42:22.336 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:42:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:42:23.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:22 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:23.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:22 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:22 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:24.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:23 smithi047 ceph-mon[29365]: pgmap v565: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:24.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:23 smithi047 ceph-mon[37680]: pgmap v565: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:24.245 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:42:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:42:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:42:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:23 smithi102 ceph-mon[32821]: pgmap v565: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:25 smithi047 ceph-mon[29365]: pgmap v566: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:25 smithi047 ceph-mon[29365]: osdmap e399: 8 total, 8 up, 8 in 2024-04-06T03:42:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:25 smithi047 ceph-mon[37680]: pgmap v566: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:25 smithi047 ceph-mon[37680]: osdmap e399: 8 total, 8 up, 8 in 2024-04-06T03:42:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:25 smithi102 ceph-mon[32821]: pgmap v566: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:25 smithi102 ceph-mon[32821]: osdmap e399: 8 total, 8 up, 8 in 2024-04-06T03:42:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:27 smithi047 ceph-mon[29365]: pgmap v568: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:27 smithi047 ceph-mon[37680]: pgmap v568: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:27 smithi102 ceph-mon[32821]: pgmap v568: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:29 smithi047 ceph-mon[29365]: pgmap v569: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:29 smithi047 ceph-mon[37680]: pgmap v569: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:29 smithi102 ceph-mon[32821]: pgmap v569: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:31.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:30 smithi047 ceph-mon[29365]: osdmap e400: 8 total, 8 up, 8 in 2024-04-06T03:42:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:30 smithi047 ceph-mon[37680]: osdmap e400: 8 total, 8 up, 8 in 2024-04-06T03:42:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:30 smithi102 ceph-mon[32821]: osdmap e400: 8 total, 8 up, 8 in 2024-04-06T03:42:32.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:31 smithi047 ceph-mon[29365]: pgmap v571: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:42:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:31 smithi047 ceph-mon[37680]: pgmap v571: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:42:32.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:42:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:42:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:31 smithi102 ceph-mon[32821]: pgmap v571: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:42:33.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:32 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:33.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:32 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:33.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:32 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:34.245 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:42:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:42:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:42:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:33 smithi047 ceph-mon[29365]: pgmap v572: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:42:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:33 smithi047 ceph-mon[37680]: pgmap v572: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:42:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:33 smithi102 ceph-mon[32821]: pgmap v572: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:42:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:36.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:35 smithi047 ceph-mon[29365]: pgmap v573: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:42:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:35 smithi047 ceph-mon[29365]: osdmap e401: 8 total, 8 up, 8 in 2024-04-06T03:42:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:35 smithi047 ceph-mon[37680]: pgmap v573: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:42:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:35 smithi047 ceph-mon[37680]: osdmap e401: 8 total, 8 up, 8 in 2024-04-06T03:42:36.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:35 smithi102 ceph-mon[32821]: pgmap v573: 260 pgs: 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:42:36.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:35 smithi102 ceph-mon[32821]: osdmap e401: 8 total, 8 up, 8 in 2024-04-06T03:42:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:37 smithi047 ceph-mon[29365]: pgmap v575: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:42:38.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:37 smithi047 ceph-mon[37680]: pgmap v575: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:42:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:37 smithi102 ceph-mon[32821]: pgmap v575: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:42:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:39 smithi047 ceph-mon[29365]: pgmap v576: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:42:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:39 smithi047 ceph-mon[37680]: pgmap v576: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:42:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:39 smithi102 ceph-mon[32821]: pgmap v576: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:42:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-63"}]: dispatch 2024-04-06T03:42:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-63"}]: dispatch 2024-04-06T03:42:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-63"}]: dispatch 2024-04-06T03:42:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-63"}]: dispatch 2024-04-06T03:42:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:41.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:41.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-63"}]: dispatch 2024-04-06T03:42:41.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-63"}]: dispatch 2024-04-06T03:42:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:41 smithi047 ceph-mon[37680]: pgmap v577: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:42:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:41 smithi047 ceph-mon[37680]: osdmap e402: 8 total, 8 up, 8 in 2024-04-06T03:42:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:41 smithi047 ceph-mon[29365]: pgmap v577: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:42:42.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:41 smithi047 ceph-mon[29365]: osdmap e402: 8 total, 8 up, 8 in 2024-04-06T03:42:42.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:42:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:42:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:41 smithi102 ceph-mon[32821]: pgmap v577: 260 pgs: 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:42:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:41 smithi102 ceph-mon[32821]: osdmap e402: 8 total, 8 up, 8 in 2024-04-06T03:42:43.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:42 smithi047 ceph-mon[37680]: osdmap e403: 8 total, 8 up, 8 in 2024-04-06T03:42:43.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:43.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:43.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:42 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:42 smithi047 ceph-mon[29365]: osdmap e403: 8 total, 8 up, 8 in 2024-04-06T03:42:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:43.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:42 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:43.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:42 smithi102 ceph-mon[32821]: osdmap e403: 8 total, 8 up, 8 in 2024-04-06T03:42:43.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:43.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:42:43.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:42 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:44.245 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:42:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:42:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[29365]: pgmap v580: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[29365]: osdmap e404: 8 total, 8 up, 8 in 2024-04-06T03:42:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[37680]: pgmap v580: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[37680]: osdmap e404: 8 total, 8 up, 8 in 2024-04-06T03:42:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:43 smithi102 ceph-mon[32821]: pgmap v580: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:43 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:42:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:43 smithi102 ceph-mon[32821]: osdmap e404: 8 total, 8 up, 8 in 2024-04-06T03:42:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:42:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:42:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:44 smithi047 ceph-mon[37680]: osdmap e405: 8 total, 8 up, 8 in 2024-04-06T03:42:45.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:45.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:44 smithi047 ceph-mon[29365]: osdmap e405: 8 total, 8 up, 8 in 2024-04-06T03:42:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:42:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:44 smithi102 ceph-mon[32821]: osdmap e405: 8 total, 8 up, 8 in 2024-04-06T03:42:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:45 smithi047 ceph-mon[29365]: pgmap v583: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:46.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:45 smithi047 ceph-mon[29365]: osdmap e406: 8 total, 8 up, 8 in 2024-04-06T03:42:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:45 smithi047 ceph-mon[37680]: pgmap v583: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:46.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:45 smithi047 ceph-mon[37680]: osdmap e406: 8 total, 8 up, 8 in 2024-04-06T03:42:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:45 smithi102 ceph-mon[32821]: pgmap v583: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:42:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:45 smithi102 ceph-mon[32821]: osdmap e406: 8 total, 8 up, 8 in 2024-04-06T03:42:47.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:46 smithi047 ceph-mon[29365]: osdmap e407: 8 total, 8 up, 8 in 2024-04-06T03:42:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:46 smithi047 ceph-mon[37680]: osdmap e407: 8 total, 8 up, 8 in 2024-04-06T03:42:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:46 smithi102 ceph-mon[32821]: osdmap e407: 8 total, 8 up, 8 in 2024-04-06T03:42:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:47 smithi047 ceph-mon[37680]: pgmap v586: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-04-06T03:42:48.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:47 smithi047 ceph-mon[37680]: osdmap e408: 8 total, 8 up, 8 in 2024-04-06T03:42:48.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:47 smithi047 ceph-mon[29365]: pgmap v586: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-04-06T03:42:48.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:47 smithi047 ceph-mon[29365]: osdmap e408: 8 total, 8 up, 8 in 2024-04-06T03:42:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:47 smithi102 ceph-mon[32821]: pgmap v586: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-04-06T03:42:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:47 smithi102 ceph-mon[32821]: osdmap e408: 8 total, 8 up, 8 in 2024-04-06T03:42:49.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:49.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:42:50.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:49 smithi047 ceph-mon[29365]: pgmap v588: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-04-06T03:42:50.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:49 smithi047 ceph-mon[37680]: pgmap v588: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-04-06T03:42:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:49 smithi102 ceph-mon[32821]: pgmap v588: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-04-06T03:42:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:50 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:50 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:50 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:42:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:51 smithi047 ceph-mon[29365]: pgmap v589: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-04-06T03:42:52.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:51 smithi047 ceph-mon[37680]: pgmap v589: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-04-06T03:42:52.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:42:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:42:52.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:51 smithi102 ceph-mon[32821]: pgmap v589: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-04-06T03:42:53.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:52 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:52 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:53.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:52 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:42:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:53 smithi047 ceph-mon[29365]: pgmap v590: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:42:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:53 smithi047 ceph-mon[37680]: pgmap v590: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:42:54.245 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:42:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:42:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:42:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:53 smithi102 ceph-mon[32821]: pgmap v590: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:42:56.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:55 smithi102 ceph-mon[32821]: pgmap v591: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:42:56.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:55 smithi102 ceph-mon[32821]: osdmap e409: 8 total, 8 up, 8 in 2024-04-06T03:42:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:55 smithi047 ceph-mon[29365]: pgmap v591: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:42:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:55 smithi047 ceph-mon[29365]: osdmap e409: 8 total, 8 up, 8 in 2024-04-06T03:42:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:55 smithi047 ceph-mon[37680]: pgmap v591: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-06T03:42:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:55 smithi047 ceph-mon[37680]: osdmap e409: 8 total, 8 up, 8 in 2024-04-06T03:42:57.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:57.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:57.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-65"}]: dispatch 2024-04-06T03:42:57.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-65"}]: dispatch 2024-04-06T03:42:57.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:57.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:57.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-65"}]: dispatch 2024-04-06T03:42:57.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-65"}]: dispatch 2024-04-06T03:42:57.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:57.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:42:57.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-65"}]: dispatch 2024-04-06T03:42:57.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-65"}]: dispatch 2024-04-06T03:42:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:58 smithi102 ceph-mon[32821]: pgmap v593: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:58.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:42:58 smithi102 ceph-mon[32821]: osdmap e410: 8 total, 8 up, 8 in 2024-04-06T03:42:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:58 smithi047 ceph-mon[29365]: pgmap v593: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:42:58 smithi047 ceph-mon[29365]: osdmap e410: 8 total, 8 up, 8 in 2024-04-06T03:42:58.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:58 smithi047 ceph-mon[37680]: pgmap v593: 260 pgs: 260 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:42:58.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:42:58 smithi047 ceph-mon[37680]: osdmap e410: 8 total, 8 up, 8 in 2024-04-06T03:43:00.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:00 smithi102 ceph-mon[32821]: pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:00.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:00 smithi102 ceph-mon[32821]: osdmap e411: 8 total, 8 up, 8 in 2024-04-06T03:43:00.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:00.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:00 smithi047 ceph-mon[29365]: pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:00 smithi047 ceph-mon[29365]: osdmap e411: 8 total, 8 up, 8 in 2024-04-06T03:43:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:00 smithi047 ceph-mon[37680]: pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:00 smithi047 ceph-mon[37680]: osdmap e411: 8 total, 8 up, 8 in 2024-04-06T03:43:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:01.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:01.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:01 smithi102 ceph-mon[32821]: osdmap e412: 8 total, 8 up, 8 in 2024-04-06T03:43:01.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:01 smithi047 ceph-mon[29365]: osdmap e412: 8 total, 8 up, 8 in 2024-04-06T03:43:01.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:01.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:01.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:01 smithi047 ceph-mon[37680]: osdmap e412: 8 total, 8 up, 8 in 2024-04-06T03:43:01.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:02.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:43:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:43:02.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:02 smithi102 ceph-mon[32821]: pgmap v598: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:02.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:02 smithi102 ceph-mon[32821]: osdmap e413: 8 total, 8 up, 8 in 2024-04-06T03:43:02.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:02.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:02.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-67"}]: dispatch 2024-04-06T03:43:02.337 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-67"}]: dispatch 2024-04-06T03:43:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[29365]: pgmap v598: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[29365]: osdmap e413: 8 total, 8 up, 8 in 2024-04-06T03:43:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-67"}]: dispatch 2024-04-06T03:43:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-67"}]: dispatch 2024-04-06T03:43:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[37680]: pgmap v598: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[37680]: osdmap e413: 8 total, 8 up, 8 in 2024-04-06T03:43:02.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:02.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:02.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-67"}]: dispatch 2024-04-06T03:43:02.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-67"}]: dispatch 2024-04-06T03:43:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:03 smithi102 ceph-mon[32821]: osdmap e414: 8 total, 8 up, 8 in 2024-04-06T03:43:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:03.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:03 smithi047 ceph-mon[29365]: osdmap e414: 8 total, 8 up, 8 in 2024-04-06T03:43:03.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:03 smithi047 ceph-mon[37680]: osdmap e414: 8 total, 8 up, 8 in 2024-04-06T03:43:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:04.046 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:43:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:43:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:43:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:04 smithi102 ceph-mon[32821]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:43:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:04 smithi102 ceph-mon[32821]: osdmap e415: 8 total, 8 up, 8 in 2024-04-06T03:43:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:04.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[29365]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:43:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[29365]: osdmap e415: 8 total, 8 up, 8 in 2024-04-06T03:43:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[37680]: pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:43:04.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[37680]: osdmap e415: 8 total, 8 up, 8 in 2024-04-06T03:43:04.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:04.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:04.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:05.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:05 smithi102 ceph-mon[32821]: osdmap e416: 8 total, 8 up, 8 in 2024-04-06T03:43:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-69"}]: dispatch 2024-04-06T03:43:05.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-69"}]: dispatch 2024-04-06T03:43:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[29365]: osdmap e416: 8 total, 8 up, 8 in 2024-04-06T03:43:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-69"}]: dispatch 2024-04-06T03:43:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-69"}]: dispatch 2024-04-06T03:43:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[37680]: osdmap e416: 8 total, 8 up, 8 in 2024-04-06T03:43:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-69"}]: dispatch 2024-04-06T03:43:05.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-69"}]: dispatch 2024-04-06T03:43:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:06 smithi102 ceph-mon[32821]: pgmap v604: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:43:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:06 smithi102 ceph-mon[32821]: osdmap e417: 8 total, 8 up, 8 in 2024-04-06T03:43:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:06 smithi047 ceph-mon[29365]: pgmap v604: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:43:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:06 smithi047 ceph-mon[29365]: osdmap e417: 8 total, 8 up, 8 in 2024-04-06T03:43:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:06 smithi047 ceph-mon[37680]: pgmap v604: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:43:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:06 smithi047 ceph-mon[37680]: osdmap e417: 8 total, 8 up, 8 in 2024-04-06T03:43:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:07 smithi102 ceph-mon[32821]: osdmap e418: 8 total, 8 up, 8 in 2024-04-06T03:43:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:07.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:07.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:07 smithi047 ceph-mon[37680]: osdmap e418: 8 total, 8 up, 8 in 2024-04-06T03:43:07.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:07.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:07.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:07 smithi047 ceph-mon[29365]: osdmap e418: 8 total, 8 up, 8 in 2024-04-06T03:43:07.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:07.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:08.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:08 smithi102 ceph-mon[32821]: pgmap v607: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:08.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:08 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:08.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:08.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:08 smithi102 ceph-mon[32821]: osdmap e419: 8 total, 8 up, 8 in 2024-04-06T03:43:08.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:08.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:43:08.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[37680]: pgmap v607: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[37680]: osdmap e419: 8 total, 8 up, 8 in 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[29365]: pgmap v607: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:08.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:08.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:08.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[29365]: osdmap e419: 8 total, 8 up, 8 in 2024-04-06T03:43:08.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:08.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:43:08.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:43:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:43:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:09 smithi102 ceph-mon[32821]: osdmap e420: 8 total, 8 up, 8 in 2024-04-06T03:43:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:43:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:09 smithi047 ceph-mon[29365]: osdmap e420: 8 total, 8 up, 8 in 2024-04-06T03:43:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:43:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:09 smithi047 ceph-mon[37680]: osdmap e420: 8 total, 8 up, 8 in 2024-04-06T03:43:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:10 smithi102 ceph-mon[32821]: pgmap v610: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:10.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:10 smithi102 ceph-mon[32821]: osdmap e421: 8 total, 8 up, 8 in 2024-04-06T03:43:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:10 smithi047 ceph-mon[29365]: pgmap v610: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:10 smithi047 ceph-mon[29365]: osdmap e421: 8 total, 8 up, 8 in 2024-04-06T03:43:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:10 smithi047 ceph-mon[37680]: pgmap v610: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:10 smithi047 ceph-mon[37680]: osdmap e421: 8 total, 8 up, 8 in 2024-04-06T03:43:12.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:43:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:43:12.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:12 smithi102 ceph-mon[32821]: pgmap v612: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 691 B/s wr, 2 op/s 2024-04-06T03:43:12.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:12 smithi047 ceph-mon[29365]: pgmap v612: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 691 B/s wr, 2 op/s 2024-04-06T03:43:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:12 smithi047 ceph-mon[37680]: pgmap v612: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 691 B/s wr, 2 op/s 2024-04-06T03:43:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:13.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:13 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:43:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:13 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:43:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:13 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:43:13.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:13 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:43:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:43:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:43:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:43:13.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:43:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:43:13.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:43:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:43:13.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:43:14.084 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:43:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:43:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:43:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:14 smithi102 ceph-mon[32821]: pgmap v613: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-04-06T03:43:14.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:14 smithi047 ceph-mon[29365]: pgmap v613: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-04-06T03:43:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:14 smithi047 ceph-mon[37680]: pgmap v613: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-04-06T03:43:16.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:16 smithi047 ceph-mon[37680]: pgmap v614: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 826 B/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:43:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:16 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:16 smithi047 ceph-mon[29365]: pgmap v614: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 826 B/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:43:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:16 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:16.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:16 smithi102 ceph-mon[32821]: pgmap v614: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 826 B/s rd, 1.7 KiB/s wr, 4 op/s 2024-04-06T03:43:16.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:16 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:18 smithi047 ceph-mon[37680]: pgmap v615: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-06T03:43:18.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:18 smithi047 ceph-mon[29365]: pgmap v615: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-06T03:43:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:18 smithi102 ceph-mon[32821]: pgmap v615: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-06T03:43:19.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:19.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:20 smithi047 ceph-mon[29365]: pgmap v616: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-04-06T03:43:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:20 smithi047 ceph-mon[37680]: pgmap v616: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-04-06T03:43:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:20 smithi102 ceph-mon[32821]: pgmap v616: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-04-06T03:43:22.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:22 smithi047 ceph-mon[29365]: pgmap v617: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 985 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-06T03:43:22.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:22 smithi047 ceph-mon[37680]: pgmap v617: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 985 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-06T03:43:22.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:43:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:43:22.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:22 smithi102 ceph-mon[32821]: pgmap v617: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 985 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-06T03:43:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:23.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:24.103 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:43:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:43:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:43:24.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:24 smithi047 ceph-mon[29365]: pgmap v618: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-04-06T03:43:24.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:24 smithi047 ceph-mon[37680]: pgmap v618: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-04-06T03:43:24.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:24 smithi102 ceph-mon[32821]: pgmap v618: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-04-06T03:43:26.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:26 smithi047 ceph-mon[29365]: pgmap v619: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:26.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:26 smithi047 ceph-mon[37680]: pgmap v619: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:26.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:26 smithi102 ceph-mon[32821]: pgmap v619: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:28.388 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:28 smithi102 ceph-mon[32821]: pgmap v620: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:28.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:28 smithi047 ceph-mon[29365]: pgmap v620: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:28.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:28 smithi047 ceph-mon[37680]: pgmap v620: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:30.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[29365]: pgmap v621: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:30.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:30.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:30.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-71"}]: dispatch 2024-04-06T03:43:30.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-71"}]: dispatch 2024-04-06T03:43:30.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[37680]: pgmap v621: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:30.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:30.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:30.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-71"}]: dispatch 2024-04-06T03:43:30.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-71"}]: dispatch 2024-04-06T03:43:30.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:30 smithi102 ceph-mon[32821]: pgmap v621: 260 pgs: 260 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:43:30.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:30.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:30.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-71"}]: dispatch 2024-04-06T03:43:30.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-71"}]: dispatch 2024-04-06T03:43:31.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:31 smithi047 ceph-mon[29365]: osdmap e422: 8 total, 8 up, 8 in 2024-04-06T03:43:31.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:31 smithi047 ceph-mon[37680]: osdmap e422: 8 total, 8 up, 8 in 2024-04-06T03:43:31.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:31 smithi102 ceph-mon[32821]: osdmap e422: 8 total, 8 up, 8 in 2024-04-06T03:43:32.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:32 smithi047 ceph-mon[29365]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-04-06T03:43:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:32 smithi047 ceph-mon[29365]: osdmap e423: 8 total, 8 up, 8 in 2024-04-06T03:43:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:32.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:32 smithi047 ceph-mon[37680]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-04-06T03:43:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:32 smithi047 ceph-mon[37680]: osdmap e423: 8 total, 8 up, 8 in 2024-04-06T03:43:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:32.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:32.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:43:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:43:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:32 smithi102 ceph-mon[32821]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-04-06T03:43:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:32 smithi102 ceph-mon[32821]: osdmap e423: 8 total, 8 up, 8 in 2024-04-06T03:43:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:32.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-mon[29365]: osdmap e424: 8 total, 8 up, 8 in 2024-04-06T03:43:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:33.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-mon[37680]: osdmap e424: 8 total, 8 up, 8 in 2024-04-06T03:43:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:33.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:33.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:33 smithi102 ceph-mon[32821]: osdmap e424: 8 total, 8 up, 8 in 2024-04-06T03:43:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:33.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:34.150 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:43:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:43:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:43:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:34 smithi047 ceph-mon[29365]: pgmap v626: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:34 smithi047 ceph-mon[29365]: osdmap e425: 8 total, 8 up, 8 in 2024-04-06T03:43:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:34 smithi047 ceph-mon[37680]: pgmap v626: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:34 smithi047 ceph-mon[37680]: osdmap e425: 8 total, 8 up, 8 in 2024-04-06T03:43:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:34.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:34 smithi102 ceph-mon[32821]: pgmap v626: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:34.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:34 smithi102 ceph-mon[32821]: osdmap e425: 8 total, 8 up, 8 in 2024-04-06T03:43:34.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:35 smithi047 ceph-mon[29365]: osdmap e426: 8 total, 8 up, 8 in 2024-04-06T03:43:35.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:35 smithi047 ceph-mon[37680]: osdmap e426: 8 total, 8 up, 8 in 2024-04-06T03:43:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:35 smithi102 ceph-mon[32821]: osdmap e426: 8 total, 8 up, 8 in 2024-04-06T03:43:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:36 smithi047 ceph-mon[29365]: pgmap v629: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:43:36.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:36 smithi047 ceph-mon[37680]: pgmap v629: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:43:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:36 smithi102 ceph-mon[32821]: pgmap v629: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:43:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:38 smithi047 ceph-mon[29365]: pgmap v630: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:43:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:38 smithi047 ceph-mon[37680]: pgmap v630: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:43:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:38 smithi102 ceph-mon[32821]: pgmap v630: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:43:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:40 smithi047 ceph-mon[29365]: pgmap v631: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-06T03:43:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:40 smithi047 ceph-mon[37680]: pgmap v631: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-06T03:43:40.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:40 smithi102 ceph-mon[32821]: pgmap v631: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-06T03:43:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:42 smithi047 ceph-mon[29365]: pgmap v632: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 895 B/s wr, 3 op/s 2024-04-06T03:43:42.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:42 smithi047 ceph-mon[37680]: pgmap v632: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 895 B/s wr, 3 op/s 2024-04-06T03:43:42.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:42 smithi102 ceph-mon[32821]: pgmap v632: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 895 B/s wr, 3 op/s 2024-04-06T03:43:42.586 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:43:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:43:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:43.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:44.171 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:43:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:43:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:43:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:44 smithi047 ceph-mon[29365]: pgmap v633: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 765 B/s wr, 3 op/s 2024-04-06T03:43:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:44 smithi047 ceph-mon[37680]: pgmap v633: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 765 B/s wr, 3 op/s 2024-04-06T03:43:44.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:44 smithi102 ceph-mon[32821]: pgmap v633: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 765 B/s wr, 3 op/s 2024-04-06T03:43:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-73"}]: dispatch 2024-04-06T03:43:45.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-73"}]: dispatch 2024-04-06T03:43:45.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:45.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:45.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-73"}]: dispatch 2024-04-06T03:43:45.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-73"}]: dispatch 2024-04-06T03:43:45.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:45.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:45.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-73"}]: dispatch 2024-04-06T03:43:45.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-73"}]: dispatch 2024-04-06T03:43:46.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:46 smithi047 ceph-mon[29365]: pgmap v634: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 691 B/s wr, 3 op/s 2024-04-06T03:43:46.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:46 smithi047 ceph-mon[29365]: osdmap e427: 8 total, 8 up, 8 in 2024-04-06T03:43:46.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:46 smithi047 ceph-mon[37680]: pgmap v634: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 691 B/s wr, 3 op/s 2024-04-06T03:43:46.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:46 smithi047 ceph-mon[37680]: osdmap e427: 8 total, 8 up, 8 in 2024-04-06T03:43:46.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:46 smithi102 ceph-mon[32821]: pgmap v634: 260 pgs: 260 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 691 B/s wr, 3 op/s 2024-04-06T03:43:46.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:46 smithi102 ceph-mon[32821]: osdmap e427: 8 total, 8 up, 8 in 2024-04-06T03:43:47.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:47 smithi047 ceph-mon[29365]: osdmap e428: 8 total, 8 up, 8 in 2024-04-06T03:43:47.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:47.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:47.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:47 smithi047 ceph-mon[37680]: osdmap e428: 8 total, 8 up, 8 in 2024-04-06T03:43:47.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:47.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:47.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:47 smithi102 ceph-mon[32821]: osdmap e428: 8 total, 8 up, 8 in 2024-04-06T03:43:47.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:47.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[29365]: pgmap v637: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:43:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[29365]: osdmap e429: 8 total, 8 up, 8 in 2024-04-06T03:43:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:48.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[37680]: pgmap v637: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:43:48.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:48.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:48.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[37680]: osdmap e429: 8 total, 8 up, 8 in 2024-04-06T03:43:48.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:48.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:48 smithi102 ceph-mon[32821]: pgmap v637: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:43:48.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:48 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:48.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:48.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:48 smithi102 ceph-mon[32821]: osdmap e429: 8 total, 8 up, 8 in 2024-04-06T03:43:48.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:49 smithi047 ceph-mon[29365]: osdmap e430: 8 total, 8 up, 8 in 2024-04-06T03:43:49.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:49.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:49 smithi047 ceph-mon[37680]: osdmap e430: 8 total, 8 up, 8 in 2024-04-06T03:43:49.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:49.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:49 smithi102 ceph-mon[32821]: osdmap e430: 8 total, 8 up, 8 in 2024-04-06T03:43:49.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[29365]: pgmap v640: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[29365]: osdmap e431: 8 total, 8 up, 8 in 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-75"}]: dispatch 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-75"}]: dispatch 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[37680]: pgmap v640: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[37680]: osdmap e431: 8 total, 8 up, 8 in 2024-04-06T03:43:50.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:50.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:50.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-75"}]: dispatch 2024-04-06T03:43:50.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-75"}]: dispatch 2024-04-06T03:43:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:50 smithi102 ceph-mon[32821]: pgmap v640: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:50 smithi102 ceph-mon[32821]: osdmap e431: 8 total, 8 up, 8 in 2024-04-06T03:43:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-75"}]: dispatch 2024-04-06T03:43:50.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-75"}]: dispatch 2024-04-06T03:43:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:51 smithi047 ceph-mon[29365]: osdmap e432: 8 total, 8 up, 8 in 2024-04-06T03:43:51.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:51 smithi047 ceph-mon[29365]: pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:51 smithi047 ceph-mon[37680]: osdmap e432: 8 total, 8 up, 8 in 2024-04-06T03:43:51.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:51 smithi047 ceph-mon[37680]: pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:51.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:51 smithi102 ceph-mon[32821]: osdmap e432: 8 total, 8 up, 8 in 2024-04-06T03:43:51.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:51 smithi102 ceph-mon[32821]: pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:43:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:52 smithi047 ceph-mon[37680]: osdmap e433: 8 total, 8 up, 8 in 2024-04-06T03:43:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:52 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:52 smithi047 ceph-mon[29365]: osdmap e433: 8 total, 8 up, 8 in 2024-04-06T03:43:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:52 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:52.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:43:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:43:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:52 smithi102 ceph-mon[32821]: osdmap e433: 8 total, 8 up, 8 in 2024-04-06T03:43:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:52 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:43:53.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:53.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-mon[37680]: osdmap e434: 8 total, 8 up, 8 in 2024-04-06T03:43:53.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:53.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-mon[37680]: pgmap v646: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-mon[29365]: osdmap e434: 8 total, 8 up, 8 in 2024-04-06T03:43:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-mon[29365]: pgmap v646: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:53 smithi102 ceph-mon[32821]: osdmap e434: 8 total, 8 up, 8 in 2024-04-06T03:43:53.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:53.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:53 smithi102 ceph-mon[32821]: pgmap v646: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:54.236 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:43:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:43:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:43:54.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[29365]: osdmap e435: 8 total, 8 up, 8 in 2024-04-06T03:43:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-77"}]: dispatch 2024-04-06T03:43:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-77"}]: dispatch 2024-04-06T03:43:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[37680]: osdmap e435: 8 total, 8 up, 8 in 2024-04-06T03:43:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:54.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-77"}]: dispatch 2024-04-06T03:43:54.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-77"}]: dispatch 2024-04-06T03:43:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:54 smithi102 ceph-mon[32821]: osdmap e435: 8 total, 8 up, 8 in 2024-04-06T03:43:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:43:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-77"}]: dispatch 2024-04-06T03:43:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-77"}]: dispatch 2024-04-06T03:43:55.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:55 smithi047 ceph-mon[29365]: osdmap e436: 8 total, 8 up, 8 in 2024-04-06T03:43:55.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:55 smithi047 ceph-mon[29365]: pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:55.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:55 smithi047 ceph-mon[37680]: osdmap e436: 8 total, 8 up, 8 in 2024-04-06T03:43:55.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:55 smithi047 ceph-mon[37680]: pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:55.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:55 smithi102 ceph-mon[32821]: osdmap e436: 8 total, 8 up, 8 in 2024-04-06T03:43:55.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:55 smithi102 ceph-mon[32821]: pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:43:56.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:56 smithi102 ceph-mon[32821]: osdmap e437: 8 total, 8 up, 8 in 2024-04-06T03:43:56.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:56.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:56.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:56 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:56.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:56 smithi047 ceph-mon[29365]: osdmap e437: 8 total, 8 up, 8 in 2024-04-06T03:43:56.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:56.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:56.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:56 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:56.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:56 smithi047 ceph-mon[37680]: osdmap e437: 8 total, 8 up, 8 in 2024-04-06T03:43:56.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:56.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:43:56.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:56 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:43:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:57 smithi102 ceph-mon[32821]: osdmap e438: 8 total, 8 up, 8 in 2024-04-06T03:43:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:57.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:57 smithi102 ceph-mon[32821]: pgmap v652: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:43:57.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:57.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:57 smithi047 ceph-mon[37680]: osdmap e438: 8 total, 8 up, 8 in 2024-04-06T03:43:57.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:57.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:57 smithi047 ceph-mon[37680]: pgmap v652: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:43:57.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:43:57.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:57 smithi047 ceph-mon[29365]: osdmap e438: 8 total, 8 up, 8 in 2024-04-06T03:43:57.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:43:57.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:57 smithi047 ceph-mon[29365]: pgmap v652: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:43:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:58 smithi102 ceph-mon[32821]: osdmap e439: 8 total, 8 up, 8 in 2024-04-06T03:43:58.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:58 smithi047 ceph-mon[29365]: osdmap e439: 8 total, 8 up, 8 in 2024-04-06T03:43:58.646 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:58 smithi047 ceph-mon[37680]: osdmap e439: 8 total, 8 up, 8 in 2024-04-06T03:43:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:59 smithi102 ceph-mon[32821]: osdmap e440: 8 total, 8 up, 8 in 2024-04-06T03:43:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.9"}]: dispatch 2024-04-06T03:43:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:59 smithi102 ceph-mon[32821]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.9"}]: dispatch 2024-04-06T03:43:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:59 smithi102 ceph-mon[32821]: 305.9 deep-scrub starts 2024-04-06T03:43:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:59 smithi102 ceph-mon[32821]: 305.9 deep-scrub ok 2024-04-06T03:43:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:43:59 smithi102 ceph-mon[32821]: pgmap v655: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:43:59.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[29365]: osdmap e440: 8 total, 8 up, 8 in 2024-04-06T03:43:59.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.9"}]: dispatch 2024-04-06T03:43:59.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[29365]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.9"}]: dispatch 2024-04-06T03:43:59.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[29365]: 305.9 deep-scrub starts 2024-04-06T03:43:59.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[29365]: 305.9 deep-scrub ok 2024-04-06T03:43:59.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[29365]: pgmap v655: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:43:59.747 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[37680]: osdmap e440: 8 total, 8 up, 8 in 2024-04-06T03:43:59.747 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.9"}]: dispatch 2024-04-06T03:43:59.747 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[37680]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.9"}]: dispatch 2024-04-06T03:43:59.747 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[37680]: 305.9 deep-scrub starts 2024-04-06T03:43:59.747 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[37680]: 305.9 deep-scrub ok 2024-04-06T03:43:59.747 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:43:59 smithi047 ceph-mon[37680]: pgmap v655: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-06T03:44:01.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:01 smithi102 ceph-mon[32821]: pgmap v656: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 970 B/s wr, 2 op/s 2024-04-06T03:44:01.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:01 smithi047 ceph-mon[29365]: pgmap v656: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 970 B/s wr, 2 op/s 2024-04-06T03:44:01.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:01 smithi047 ceph-mon[37680]: pgmap v656: 260 pgs: 260 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 970 B/s wr, 2 op/s 2024-04-06T03:44:02.575 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:44:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:44:02.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:02 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:02.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:02 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:02.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:02 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:03.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:03 smithi102 ceph-mon[32821]: pgmap v657: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 1.1 KiB/s wr, 117 op/s 2024-04-06T03:44:03.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:03 smithi047 ceph-mon[29365]: pgmap v657: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 1.1 KiB/s wr, 117 op/s 2024-04-06T03:44:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:03.995 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:44:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:44:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:44:03.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:03 smithi047 ceph-mon[37680]: pgmap v657: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 1.1 KiB/s wr, 117 op/s 2024-04-06T03:44:03.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:05.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:05 smithi102 ceph-mon[32821]: pgmap v658: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 255 B/s wr, 90 op/s 2024-04-06T03:44:05.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:05 smithi047 ceph-mon[29365]: pgmap v658: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 255 B/s wr, 90 op/s 2024-04-06T03:44:05.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:05 smithi047 ceph-mon[37680]: pgmap v658: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 255 B/s wr, 90 op/s 2024-04-06T03:44:07.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:07 smithi102 ceph-mon[32821]: pgmap v659: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 221 B/s wr, 79 op/s 2024-04-06T03:44:07.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:07 smithi047 ceph-mon[29365]: pgmap v659: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 221 B/s wr, 79 op/s 2024-04-06T03:44:07.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:07 smithi047 ceph-mon[37680]: pgmap v659: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 221 B/s wr, 79 op/s 2024-04-06T03:44:09.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:09 smithi102 ceph-mon[32821]: pgmap v660: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 43 KiB/s rd, 199 B/s wr, 71 op/s 2024-04-06T03:44:09.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:09 smithi047 ceph-mon[29365]: pgmap v660: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 43 KiB/s rd, 199 B/s wr, 71 op/s 2024-04-06T03:44:09.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:09 smithi047 ceph-mon[37680]: pgmap v660: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 43 KiB/s rd, 199 B/s wr, 71 op/s 2024-04-06T03:44:11.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:11 smithi047 ceph-mon[29365]: pgmap v661: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 60 op/s 2024-04-06T03:44:11.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:11 smithi047 ceph-mon[37680]: pgmap v661: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 60 op/s 2024-04-06T03:44:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:11 smithi102 ceph-mon[32821]: pgmap v661: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 60 op/s 2024-04-06T03:44:12.586 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:44:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:44:12.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:12 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:12.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:12 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:13.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:12 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:13 smithi047 ceph-mon[37680]: pgmap v662: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 61 op/s 2024-04-06T03:44:13.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:13 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:44:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:13 smithi047 ceph-mon[29365]: pgmap v662: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 61 op/s 2024-04-06T03:44:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:13 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:44:13.995 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:44:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:44:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:44:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:13 smithi102 ceph-mon[32821]: pgmap v662: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 61 op/s 2024-04-06T03:44:14.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:13 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:44:14.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:14 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:44:14.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:14 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:44:14.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:14 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:44:14.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:14 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:44:14.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:14 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:44:14.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:14 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:44:15.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:14 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:44:15.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:14 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:44:15.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:14 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:44:15.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:15 smithi047 ceph-mon[29365]: pgmap v663: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:44:15.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:15 smithi047 ceph-mon[37680]: pgmap v663: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:44:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:15 smithi102 ceph-mon[32821]: pgmap v663: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:44:18.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:17 smithi047 ceph-mon[29365]: pgmap v664: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:18.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:17 smithi047 ceph-mon[37680]: pgmap v664: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:18.298 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:17 smithi102 ceph-mon[32821]: pgmap v664: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:18.585 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 03:44:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T03:44:18.294+0000 7fe4a36b1700 -1 snap_mapper.add_oid found existing snaps mapped on 305:902fe003:test-rados-api-smithi047-74676-80::foo:2, removing 2024-04-06T03:44:18.745 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0[41662]: 2024-04-06T03:44:18.294+0000 7ff465839700 -1 snap_mapper.add_oid found existing snaps mapped on 305:902fe003:test-rados-api-smithi047-74676-80::foo:2, removing 2024-04-06T03:44:18.745 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2[53300]: 2024-04-06T03:44:18.294+0000 7fee9cd9a700 -1 snap_mapper.add_oid found existing snaps mapped on 305:902fe003:test-rados-api-smithi047-74676-80::foo:2, removing 2024-04-06T03:44:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-79"}]: dispatch 2024-04-06T03:44:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-79"}]: dispatch 2024-04-06T03:44:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-79"}]: dispatch 2024-04-06T03:44:19.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-79"}]: dispatch 2024-04-06T03:44:19.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-79"}]: dispatch 2024-04-06T03:44:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-79"}]: dispatch 2024-04-06T03:44:19.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:19 smithi047 ceph-mon[29365]: pgmap v665: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:44:20.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:19 smithi047 ceph-mon[29365]: osdmap e441: 8 total, 8 up, 8 in 2024-04-06T03:44:20.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:19 smithi047 ceph-mon[37680]: pgmap v665: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:44:20.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:19 smithi047 ceph-mon[37680]: osdmap e441: 8 total, 8 up, 8 in 2024-04-06T03:44:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:19 smithi102 ceph-mon[32821]: pgmap v665: 260 pgs: 260 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:44:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:19 smithi102 ceph-mon[32821]: osdmap e441: 8 total, 8 up, 8 in 2024-04-06T03:44:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:20 smithi047 ceph-mon[29365]: osdmap e442: 8 total, 8 up, 8 in 2024-04-06T03:44:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:21.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:20 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:20 smithi047 ceph-mon[37680]: osdmap e442: 8 total, 8 up, 8 in 2024-04-06T03:44:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:21.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:20 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:20 smithi102 ceph-mon[32821]: osdmap e442: 8 total, 8 up, 8 in 2024-04-06T03:44:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:21.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:20 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:22.206 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:21 smithi102 ceph-mon[32821]: pgmap v668: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:44:22.206 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:21 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:22.206 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:22.206 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:21 smithi102 ceph-mon[32821]: osdmap e443: 8 total, 8 up, 8 in 2024-04-06T03:44:22.206 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:22.206 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:22.206 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:22.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[29365]: pgmap v668: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[29365]: osdmap e443: 8 total, 8 up, 8 in 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[37680]: pgmap v668: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:22.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[37680]: osdmap e443: 8 total, 8 up, 8 in 2024-04-06T03:44:22.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:22.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:22.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:22.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:44:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:44:23.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:23.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[29365]: osdmap e444: 8 total, 8 up, 8 in 2024-04-06T03:44:23.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:23.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:23.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:23.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:23.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[37680]: osdmap e444: 8 total, 8 up, 8 in 2024-04-06T03:44:23.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:23.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:23.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:22 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:22 smithi102 ceph-mon[32821]: osdmap e444: 8 total, 8 up, 8 in 2024-04-06T03:44:23.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:23.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:22 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:23.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:22 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:24.245 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:44:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:44:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[29365]: pgmap v671: 260 pgs: 260 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-04-06T03:44:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[29365]: osdmap e445: 8 total, 8 up, 8 in 2024-04-06T03:44:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:24.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:24.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[37680]: pgmap v671: 260 pgs: 260 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-04-06T03:44:24.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:24.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[37680]: osdmap e445: 8 total, 8 up, 8 in 2024-04-06T03:44:24.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:24.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:23 smithi102 ceph-mon[32821]: pgmap v671: 260 pgs: 260 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-04-06T03:44:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:23 smithi102 ceph-mon[32821]: osdmap e445: 8 total, 8 up, 8 in 2024-04-06T03:44:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:24.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:25.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:25.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[29365]: osdmap e446: 8 total, 8 up, 8 in 2024-04-06T03:44:25.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:25.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:25.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:25.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:25.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[37680]: osdmap e446: 8 total, 8 up, 8 in 2024-04-06T03:44:25.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:25.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:25.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:25.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:25.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:24 smithi102 ceph-mon[32821]: osdmap e446: 8 total, 8 up, 8 in 2024-04-06T03:44:25.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:25.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:25.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:25 smithi047 ceph-mon[29365]: pgmap v674: 260 pgs: 260 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:44:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:25 smithi047 ceph-mon[29365]: osdmap e447: 8 total, 8 up, 8 in 2024-04-06T03:44:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-06T03:44:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-06T03:44:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:25 smithi047 ceph-mon[37680]: pgmap v674: 260 pgs: 260 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:44:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:25 smithi047 ceph-mon[37680]: osdmap e447: 8 total, 8 up, 8 in 2024-04-06T03:44:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-06T03:44:26.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-06T03:44:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:25 smithi102 ceph-mon[32821]: pgmap v674: 260 pgs: 260 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:44:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:25 smithi102 ceph-mon[32821]: osdmap e447: 8 total, 8 up, 8 in 2024-04-06T03:44:26.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-06T03:44:26.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-06T03:44:27.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-04-06T03:44:27.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:26 smithi047 ceph-mon[29365]: osdmap e448: 8 total, 8 up, 8 in 2024-04-06T03:44:27.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-06T03:44:27.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-06T03:44:27.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-04-06T03:44:27.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:26 smithi047 ceph-mon[37680]: osdmap e448: 8 total, 8 up, 8 in 2024-04-06T03:44:27.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-06T03:44:27.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-06T03:44:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-04-06T03:44:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:26 smithi102 ceph-mon[32821]: osdmap e448: 8 total, 8 up, 8 in 2024-04-06T03:44:27.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-06T03:44:27.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-06T03:44:28.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:27 smithi102 ceph-mon[32821]: pgmap v677: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-04-06T03:44:28.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-04-06T03:44:28.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:27 smithi102 ceph-mon[32821]: osdmap e449: 8 total, 8 up, 8 in 2024-04-06T03:44:28.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:28.237 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[37680]: pgmap v677: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[37680]: osdmap e449: 8 total, 8 up, 8 in 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[29365]: pgmap v677: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[29365]: osdmap e449: 8 total, 8 up, 8 in 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[29365]: osdmap e450: 8 total, 8 up, 8 in 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-81"}]: dispatch 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-81"}]: dispatch 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[37680]: osdmap e450: 8 total, 8 up, 8 in 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:29.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-81"}]: dispatch 2024-04-06T03:44:29.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-81"}]: dispatch 2024-04-06T03:44:29.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:29.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:28 smithi102 ceph-mon[32821]: osdmap e450: 8 total, 8 up, 8 in 2024-04-06T03:44:29.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:29.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:29.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-81"}]: dispatch 2024-04-06T03:44:29.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-81"}]: dispatch 2024-04-06T03:44:30.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:29 smithi047 ceph-mon[29365]: pgmap v680: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-04-06T03:44:30.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:29 smithi047 ceph-mon[29365]: osdmap e451: 8 total, 8 up, 8 in 2024-04-06T03:44:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:29 smithi047 ceph-mon[37680]: pgmap v680: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-04-06T03:44:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:29 smithi047 ceph-mon[37680]: osdmap e451: 8 total, 8 up, 8 in 2024-04-06T03:44:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:29 smithi102 ceph-mon[32821]: pgmap v680: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-04-06T03:44:30.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:29 smithi102 ceph-mon[32821]: osdmap e451: 8 total, 8 up, 8 in 2024-04-06T03:44:31.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:30 smithi047 ceph-mon[29365]: osdmap e452: 8 total, 8 up, 8 in 2024-04-06T03:44:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:31.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:30 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:30 smithi047 ceph-mon[37680]: osdmap e452: 8 total, 8 up, 8 in 2024-04-06T03:44:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:31.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:30 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:30 smithi102 ceph-mon[32821]: osdmap e452: 8 total, 8 up, 8 in 2024-04-06T03:44:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:31.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:30 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:32.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[29365]: pgmap v683: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[29365]: osdmap e453: 8 total, 8 up, 8 in 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[37680]: pgmap v683: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[37680]: osdmap e453: 8 total, 8 up, 8 in 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:32.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:32.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:31 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:32.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:44:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:44:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:31 smithi102 ceph-mon[32821]: pgmap v683: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:31 smithi102 ceph-mon[32821]: osdmap e453: 8 total, 8 up, 8 in 2024-04-06T03:44:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:32.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:31 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[29365]: osdmap e454: 8 total, 8 up, 8 in 2024-04-06T03:44:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:33.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[37680]: osdmap e454: 8 total, 8 up, 8 in 2024-04-06T03:44:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:33.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:33.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:33.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:32 smithi102 ceph-mon[32821]: osdmap e454: 8 total, 8 up, 8 in 2024-04-06T03:44:33.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:33.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:33.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:32 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:33.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:34.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:44:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: pgmap v686: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: osdmap e455: 8 total, 8 up, 8 in 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: osdmap e456: 8 total, 8 up, 8 in 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: pgmap v686: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: osdmap e455: 8 total, 8 up, 8 in 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: osdmap e456: 8 total, 8 up, 8 in 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: pgmap v686: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2024-04-06T03:44:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: osdmap e455: 8 total, 8 up, 8 in 2024-04-06T03:44:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: osdmap e456: 8 total, 8 up, 8 in 2024-04-06T03:44:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:34.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:35 smithi047 ceph-mon[29365]: pgmap v689: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-04-06T03:44:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:36.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:35 smithi047 ceph-mon[29365]: osdmap e457: 8 total, 8 up, 8 in 2024-04-06T03:44:36.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:35 smithi047 ceph-mon[37680]: pgmap v689: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-04-06T03:44:36.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:36.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:35 smithi047 ceph-mon[37680]: osdmap e457: 8 total, 8 up, 8 in 2024-04-06T03:44:36.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:35 smithi102 ceph-mon[32821]: pgmap v689: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-04-06T03:44:36.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:36.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:35 smithi102 ceph-mon[32821]: osdmap e457: 8 total, 8 up, 8 in 2024-04-06T03:44:37.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:36 smithi102 ceph-mon[32821]: osdmap e458: 8 total, 8 up, 8 in 2024-04-06T03:44:37.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:36 smithi047 ceph-mon[29365]: osdmap e458: 8 total, 8 up, 8 in 2024-04-06T03:44:37.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:36 smithi047 ceph-mon[37680]: osdmap e458: 8 total, 8 up, 8 in 2024-04-06T03:44:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:38 smithi102 ceph-mon[32821]: pgmap v692: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-04-06T03:44:38.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:38 smithi102 ceph-mon[32821]: osdmap e459: 8 total, 8 up, 8 in 2024-04-06T03:44:38.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:38.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:38.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-83"}]: dispatch 2024-04-06T03:44:38.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-83"}]: dispatch 2024-04-06T03:44:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:37 smithi047 ceph-mon[29365]: pgmap v692: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-04-06T03:44:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:37 smithi047 ceph-mon[29365]: osdmap e459: 8 total, 8 up, 8 in 2024-04-06T03:44:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-83"}]: dispatch 2024-04-06T03:44:38.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-83"}]: dispatch 2024-04-06T03:44:38.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:37 smithi047 ceph-mon[37680]: pgmap v692: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-04-06T03:44:38.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:38 smithi047 ceph-mon[37680]: osdmap e459: 8 total, 8 up, 8 in 2024-04-06T03:44:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-83"}]: dispatch 2024-04-06T03:44:38.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-83"}]: dispatch 2024-04-06T03:44:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:39 smithi102 ceph-mon[32821]: osdmap e460: 8 total, 8 up, 8 in 2024-04-06T03:44:39.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:39 smithi047 ceph-mon[29365]: osdmap e460: 8 total, 8 up, 8 in 2024-04-06T03:44:39.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:39 smithi047 ceph-mon[37680]: osdmap e460: 8 total, 8 up, 8 in 2024-04-06T03:44:40.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:40 smithi102 ceph-mon[32821]: pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:44:40.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:40 smithi102 ceph-mon[32821]: osdmap e461: 8 total, 8 up, 8 in 2024-04-06T03:44:40.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:40.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:40 smithi047 ceph-mon[29365]: pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:44:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:40 smithi047 ceph-mon[29365]: osdmap e461: 8 total, 8 up, 8 in 2024-04-06T03:44:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:40.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:40 smithi047 ceph-mon[37680]: pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:44:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:40 smithi047 ceph-mon[37680]: osdmap e461: 8 total, 8 up, 8 in 2024-04-06T03:44:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:40.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:41 smithi102 ceph-mon[32821]: osdmap e462: 8 total, 8 up, 8 in 2024-04-06T03:44:41.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:41.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:41.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[29365]: osdmap e462: 8 total, 8 up, 8 in 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[37680]: osdmap e462: 8 total, 8 up, 8 in 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:41.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:41.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:42.335 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:44:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:44:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:42 smithi102 ceph-mon[32821]: pgmap v698: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:42 smithi102 ceph-mon[32821]: osdmap e463: 8 total, 8 up, 8 in 2024-04-06T03:44:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:42.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[29365]: pgmap v698: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[29365]: osdmap e463: 8 total, 8 up, 8 in 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[37680]: pgmap v698: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[37680]: osdmap e463: 8 total, 8 up, 8 in 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:42.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:43.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:43.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:43 smithi102 ceph-mon[32821]: osdmap e464: 8 total, 8 up, 8 in 2024-04-06T03:44:43.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:43.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:43.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:43.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:43 smithi102 ceph-mon[32821]: osdmap e465: 8 total, 8 up, 8 in 2024-04-06T03:44:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[37680]: osdmap e464: 8 total, 8 up, 8 in 2024-04-06T03:44:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:43.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[37680]: osdmap e465: 8 total, 8 up, 8 in 2024-04-06T03:44:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_tier","val": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:44:43.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[29365]: osdmap e464: 8 total, 8 up, 8 in 2024-04-06T03:44:43.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:43.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:43.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:43.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-mon[29365]: osdmap e465: 8 total, 8 up, 8 in 2024-04-06T03:44:44.046 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:44:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:44:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:44:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:44 smithi102 ceph-mon[32821]: pgmap v701: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-06T03:44:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:44.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:44 smithi102 ceph-mon[32821]: osdmap e466: 8 total, 8 up, 8 in 2024-04-06T03:44:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[29365]: pgmap v701: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-06T03:44:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:44.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[29365]: osdmap e466: 8 total, 8 up, 8 in 2024-04-06T03:44:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:44.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[37680]: pgmap v701: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-06T03:44:44.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:44.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:44.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:44.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:44 smithi047 ceph-mon[37680]: osdmap e466: 8 total, 8 up, 8 in 2024-04-06T03:44:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:46 smithi102 ceph-mon[32821]: pgmap v704: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-06T03:44:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:46 smithi102 ceph-mon[32821]: osdmap e467: 8 total, 8 up, 8 in 2024-04-06T03:44:46.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:46 smithi047 ceph-mon[37680]: pgmap v704: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-06T03:44:46.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:46 smithi047 ceph-mon[37680]: osdmap e467: 8 total, 8 up, 8 in 2024-04-06T03:44:46.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:46 smithi047 ceph-mon[29365]: pgmap v704: 260 pgs: 260 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-06T03:44:46.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:46 smithi047 ceph-mon[29365]: osdmap e467: 8 total, 8 up, 8 in 2024-04-06T03:44:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:47 smithi102 ceph-mon[32821]: osdmap e468: 8 total, 8 up, 8 in 2024-04-06T03:44:47.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:47.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:47.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-85"}]: dispatch 2024-04-06T03:44:47.336 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-85"}]: dispatch 2024-04-06T03:44:47.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[29365]: osdmap e468: 8 total, 8 up, 8 in 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-85"}]: dispatch 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-85"}]: dispatch 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[37680]: osdmap e468: 8 total, 8 up, 8 in 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-85"}]: dispatch 2024-04-06T03:44:47.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-85"}]: dispatch 2024-04-06T03:44:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:48 smithi102 ceph-mon[32821]: pgmap v707: 260 pgs: 260 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 7.5 KiB/s wr, 12 op/s 2024-04-06T03:44:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:48 smithi102 ceph-mon[32821]: osdmap e469: 8 total, 8 up, 8 in 2024-04-06T03:44:48.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:48 smithi047 ceph-mon[29365]: pgmap v707: 260 pgs: 260 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 7.5 KiB/s wr, 12 op/s 2024-04-06T03:44:48.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:48 smithi047 ceph-mon[29365]: osdmap e469: 8 total, 8 up, 8 in 2024-04-06T03:44:48.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:48 smithi047 ceph-mon[37680]: pgmap v707: 260 pgs: 260 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 7.5 KiB/s wr, 12 op/s 2024-04-06T03:44:48.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:48 smithi047 ceph-mon[37680]: osdmap e469: 8 total, 8 up, 8 in 2024-04-06T03:44:49.082 INFO:tasks.workunit.client.0.smithi047.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18079 ms) 2024-04-06T03:44:49.082 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-04-06T03:44:49.082 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22427 ms) 2024-04-06T03:44:49.082 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-06T03:44:49.082 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3024 ms) 2024-04-06T03:44:49.082 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-06T03:44:49.082 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.082 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3020 ms) 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3006 ms) 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3006 ms) 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4041 ms) 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38289 ms) 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17068 ms) 2024-04-06T03:44:49.083 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4019 ms) 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3033 ms) 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25062 ms) 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15060 ms) 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.084 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5034 ms) 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4019 ms) 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: waiting for scrubs... 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: done waiting 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24668 ms) 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10063 ms) 2024-04-06T03:44:49.085 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-06T03:44:49.086 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.086 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9046 ms) 2024-04-06T03:44:49.086 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-06T03:44:49.086 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:44:49.086 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9060 ms) 2024-04-06T03:44:49.086 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-06T03:44:49.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[29365]: osdmap e470: 8 total, 8 up, 8 in 2024-04-06T03:44:49.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:49.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:49.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:49.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:49.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[29365]: osdmap e471: 8 total, 8 up, 8 in 2024-04-06T03:44:49.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[37680]: osdmap e470: 8 total, 8 up, 8 in 2024-04-06T03:44:49.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:49.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:49.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:49.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:49.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:49 smithi047 ceph-mon[37680]: osdmap e471: 8 total, 8 up, 8 in 2024-04-06T03:44:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:49 smithi102 ceph-mon[32821]: osdmap e470: 8 total, 8 up, 8 in 2024-04-06T03:44:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:44:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:49.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:49 smithi102 ceph-mon[32821]: osdmap e471: 8 total, 8 up, 8 in 2024-04-06T03:44:50.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[29365]: pgmap v710: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[29365]: osdmap e472: 8 total, 8 up, 8 in 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[37680]: pgmap v710: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[37680]: osdmap e472: 8 total, 8 up, 8 in 2024-04-06T03:44:50.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:50.746 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:50.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:50 smithi102 ceph-mon[32821]: pgmap v710: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-04-06T03:44:50.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:50 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:50.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:50.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:50 smithi102 ceph-mon[32821]: osdmap e472: 8 total, 8 up, 8 in 2024-04-06T03:44:50.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:50.836 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[29365]: pgmap v713: 292 pgs: 64 unknown, 228 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[29365]: osdmap e473: 8 total, 8 up, 8 in 2024-04-06T03:44:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]: dispatch 2024-04-06T03:44:52.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]: dispatch 2024-04-06T03:44:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[37680]: pgmap v713: 292 pgs: 64 unknown, 228 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:52.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[37680]: osdmap e473: 8 total, 8 up, 8 in 2024-04-06T03:44:52.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]: dispatch 2024-04-06T03:44:52.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]: dispatch 2024-04-06T03:44:52.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:44:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:44:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:52 smithi102 ceph-mon[32821]: pgmap v713: 292 pgs: 64 unknown, 228 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:44:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:44:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:52 smithi102 ceph-mon[32821]: osdmap e473: 8 total, 8 up, 8 in 2024-04-06T03:44:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]: dispatch 2024-04-06T03:44:52.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]: dispatch 2024-04-06T03:44:53.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]': finished 2024-04-06T03:44:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-mon[29365]: osdmap e474: 8 total, 8 up, 8 in 2024-04-06T03:44:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:53.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:53.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]': finished 2024-04-06T03:44:53.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-mon[37680]: osdmap e474: 8 total, 8 up, 8 in 2024-04-06T03:44:53.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:53.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_tier","val": "test-rados-api-smithi047-74676-89-test-flush"}]': finished 2024-04-06T03:44:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:53 smithi102 ceph-mon[32821]: osdmap e474: 8 total, 8 up, 8 in 2024-04-06T03:44:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:53.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:44:54.108 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:44:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:44:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:44:54.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[29365]: pgmap v716: 292 pgs: 292 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[29365]: osdmap e475: 8 total, 8 up, 8 in 2024-04-06T03:44:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:54.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:54.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[37680]: pgmap v716: 292 pgs: 292 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:54.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:54.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[37680]: osdmap e475: 8 total, 8 up, 8 in 2024-04-06T03:44:54.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:54.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:44:54.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:54 smithi102 ceph-mon[32821]: pgmap v716: 292 pgs: 292 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:44:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:54 smithi102 ceph-mon[32821]: osdmap e475: 8 total, 8 up, 8 in 2024-04-06T03:44:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:54.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:44:55.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:55.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:55 smithi047 ceph-mon[29365]: osdmap e476: 8 total, 8 up, 8 in 2024-04-06T03:44:55.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:55.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:55 smithi047 ceph-mon[37680]: osdmap e476: 8 total, 8 up, 8 in 2024-04-06T03:44:55.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:44:55.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:55 smithi102 ceph-mon[32821]: osdmap e476: 8 total, 8 up, 8 in 2024-04-06T03:44:56.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[29365]: pgmap v719: 292 pgs: 292 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[29365]: osdmap e477: 8 total, 8 up, 8 in 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-87"}]: dispatch 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-87"}]: dispatch 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[37680]: pgmap v719: 292 pgs: 292 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[37680]: osdmap e477: 8 total, 8 up, 8 in 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:56.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-87"}]: dispatch 2024-04-06T03:44:56.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-87"}]: dispatch 2024-04-06T03:44:56.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:56 smithi102 ceph-mon[32821]: pgmap v719: 292 pgs: 292 active+clean; 8.4 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:44:56.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:56 smithi102 ceph-mon[32821]: osdmap e477: 8 total, 8 up, 8 in 2024-04-06T03:44:56.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:56.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:44:56.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-87"}]: dispatch 2024-04-06T03:44:56.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-87"}]: dispatch 2024-04-06T03:44:57.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:57 smithi047 ceph-mon[29365]: osdmap e478: 8 total, 8 up, 8 in 2024-04-06T03:44:57.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:57 smithi047 ceph-mon[37680]: osdmap e478: 8 total, 8 up, 8 in 2024-04-06T03:44:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:57 smithi102 ceph-mon[32821]: osdmap e478: 8 total, 8 up, 8 in 2024-04-06T03:44:58.395 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[29365]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:44:58.395 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:58.395 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[29365]: osdmap e479: 8 total, 8 up, 8 in 2024-04-06T03:44:58.395 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:58.396 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:58.396 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[37680]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:44:58.396 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:58.396 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[37680]: osdmap e479: 8 total, 8 up, 8 in 2024-04-06T03:44:58.396 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:58.396 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:58.486 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:58 smithi102 ceph-mon[32821]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:44:58.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:58 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:44:58.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:58 smithi102 ceph-mon[32821]: osdmap e479: 8 total, 8 up, 8 in 2024-04-06T03:44:58.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:58.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[37680]: osdmap e480: 8 total, 8 up, 8 in 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[29365]: osdmap e480: 8 total, 8 up, 8 in 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:59.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:44:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:44:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:59 smithi102 ceph-mon[32821]: osdmap e480: 8 total, 8 up, 8 in 2024-04-06T03:44:59.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:44:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:44:59.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:44:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:45:00.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:00 smithi047 ceph-mon[37680]: pgmap v725: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:45:00.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:45:00.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:00 smithi047 ceph-mon[37680]: osdmap e481: 8 total, 8 up, 8 in 2024-04-06T03:45:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:00 smithi047 ceph-mon[29365]: pgmap v725: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:45:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:45:00.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:00 smithi047 ceph-mon[29365]: osdmap e481: 8 total, 8 up, 8 in 2024-04-06T03:45:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:00 smithi102 ceph-mon[32821]: pgmap v725: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:45:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:45:00.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:00 smithi102 ceph-mon[32821]: osdmap e481: 8 total, 8 up, 8 in 2024-04-06T03:45:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:01 smithi047 ceph-mon[29365]: osdmap e482: 8 total, 8 up, 8 in 2024-04-06T03:45:01.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:01 smithi047 ceph-mon[37680]: osdmap e482: 8 total, 8 up, 8 in 2024-04-06T03:45:01.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:01 smithi102 ceph-mon[32821]: osdmap e482: 8 total, 8 up, 8 in 2024-04-06T03:45:02.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[29365]: pgmap v728: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[29365]: osdmap e483: 8 total, 8 up, 8 in 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-90"}]: dispatch 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-90"}]: dispatch 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[37680]: pgmap v728: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[37680]: osdmap e483: 8 total, 8 up, 8 in 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-90"}]: dispatch 2024-04-06T03:45:02.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-90"}]: dispatch 2024-04-06T03:45:02.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:45:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:45:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:02 smithi102 ceph-mon[32821]: pgmap v728: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:02.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:02 smithi102 ceph-mon[32821]: osdmap e483: 8 total, 8 up, 8 in 2024-04-06T03:45:02.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:02.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:02.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-90"}]: dispatch 2024-04-06T03:45:02.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-90"}]: dispatch 2024-04-06T03:45:03.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:03 smithi047 ceph-mon[29365]: osdmap e484: 8 total, 8 up, 8 in 2024-04-06T03:45:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:03 smithi047 ceph-mon[37680]: osdmap e484: 8 total, 8 up, 8 in 2024-04-06T03:45:03.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:03 smithi102 ceph-mon[32821]: osdmap e484: 8 total, 8 up, 8 in 2024-04-06T03:45:04.183 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:45:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:45:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[29365]: pgmap v731: 228 pgs: 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[29365]: osdmap e485: 8 total, 8 up, 8 in 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[37680]: pgmap v731: 228 pgs: 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[37680]: osdmap e485: 8 total, 8 up, 8 in 2024-04-06T03:45:04.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:04.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:04.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:04.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:04.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:04 smithi102 ceph-mon[32821]: pgmap v731: 228 pgs: 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:45:04.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:04 smithi102 ceph-mon[32821]: osdmap e485: 8 total, 8 up, 8 in 2024-04-06T03:45:04.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:04.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:04.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:05 smithi047 ceph-mon[29365]: osdmap e486: 8 total, 8 up, 8 in 2024-04-06T03:45:05.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:05 smithi047 ceph-mon[37680]: osdmap e486: 8 total, 8 up, 8 in 2024-04-06T03:45:05.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:05 smithi102 ceph-mon[32821]: osdmap e486: 8 total, 8 up, 8 in 2024-04-06T03:45:05.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:06 smithi047 ceph-mon[29365]: pgmap v734: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:45:06.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:06 smithi047 ceph-mon[29365]: osdmap e487: 8 total, 8 up, 8 in 2024-04-06T03:45:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:06 smithi047 ceph-mon[37680]: pgmap v734: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:45:06.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:06 smithi047 ceph-mon[37680]: osdmap e487: 8 total, 8 up, 8 in 2024-04-06T03:45:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:06 smithi102 ceph-mon[32821]: pgmap v734: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-06T03:45:06.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:06 smithi102 ceph-mon[32821]: osdmap e487: 8 total, 8 up, 8 in 2024-04-06T03:45:07.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[29365]: osdmap e488: 8 total, 8 up, 8 in 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-92"}]: dispatch 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-92"}]: dispatch 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[37680]: osdmap e488: 8 total, 8 up, 8 in 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-92"}]: dispatch 2024-04-06T03:45:07.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-92"}]: dispatch 2024-04-06T03:45:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:07 smithi102 ceph-mon[32821]: osdmap e488: 8 total, 8 up, 8 in 2024-04-06T03:45:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-92"}]: dispatch 2024-04-06T03:45:07.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-92"}]: dispatch 2024-04-06T03:45:08.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:08 smithi047 ceph-mon[29365]: pgmap v737: 260 pgs: 260 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-04-06T03:45:08.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:08 smithi047 ceph-mon[29365]: osdmap e489: 8 total, 8 up, 8 in 2024-04-06T03:45:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:08 smithi047 ceph-mon[37680]: pgmap v737: 260 pgs: 260 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-04-06T03:45:08.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:08 smithi047 ceph-mon[37680]: osdmap e489: 8 total, 8 up, 8 in 2024-04-06T03:45:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:08 smithi102 ceph-mon[32821]: pgmap v737: 260 pgs: 260 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-04-06T03:45:08.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:08 smithi102 ceph-mon[32821]: osdmap e489: 8 total, 8 up, 8 in 2024-04-06T03:45:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[29365]: osdmap e490: 8 total, 8 up, 8 in 2024-04-06T03:45:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[29365]: pgmap v740: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[29365]: osdmap e491: 8 total, 8 up, 8 in 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[37680]: osdmap e490: 8 total, 8 up, 8 in 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[37680]: pgmap v740: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:09.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:09 smithi047 ceph-mon[37680]: osdmap e491: 8 total, 8 up, 8 in 2024-04-06T03:45:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:09 smithi102 ceph-mon[32821]: osdmap e490: 8 total, 8 up, 8 in 2024-04-06T03:45:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:09 smithi102 ceph-mon[32821]: pgmap v740: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:45:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:09.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:09 smithi102 ceph-mon[32821]: osdmap e491: 8 total, 8 up, 8 in 2024-04-06T03:45:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:10 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:10.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:10 smithi047 ceph-mon[37680]: osdmap e492: 8 total, 8 up, 8 in 2024-04-06T03:45:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:10 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:10.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:10 smithi047 ceph-mon[29365]: osdmap e492: 8 total, 8 up, 8 in 2024-04-06T03:45:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:10 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:10.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:10 smithi102 ceph-mon[32821]: osdmap e492: 8 total, 8 up, 8 in 2024-04-06T03:45:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:12 smithi047 ceph-mon[37680]: pgmap v743: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:12.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:12 smithi047 ceph-mon[37680]: osdmap e493: 8 total, 8 up, 8 in 2024-04-06T03:45:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:12 smithi047 ceph-mon[29365]: pgmap v743: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:12.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:12 smithi047 ceph-mon[29365]: osdmap e493: 8 total, 8 up, 8 in 2024-04-06T03:45:12.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:45:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:45:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:12 smithi102 ceph-mon[32821]: pgmap v743: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:12.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:12 smithi102 ceph-mon[32821]: osdmap e493: 8 total, 8 up, 8 in 2024-04-06T03:45:14.213 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:45:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:45:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:45:14.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:14.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:14 smithi047 ceph-mon[29365]: pgmap v745: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-06T03:45:14.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:14 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:45:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:14 smithi047 ceph-mon[37680]: pgmap v745: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-06T03:45:14.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:14 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:45:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:14 smithi102 ceph-mon[32821]: pgmap v745: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-06T03:45:14.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:14 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:45:15.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:45:15.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:45:15.496 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:45:15.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:45:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:16 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi047 to 3249M 2024-04-06T03:45:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:16 smithi047 ceph-mon[29365]: Adjusting osd_memory_target on smithi102 to 3248M 2024-04-06T03:45:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:16 smithi047 ceph-mon[29365]: pgmap v746: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:45:16.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:16 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:16 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi047 to 3249M 2024-04-06T03:45:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:16 smithi047 ceph-mon[37680]: Adjusting osd_memory_target on smithi102 to 3248M 2024-04-06T03:45:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:16 smithi047 ceph-mon[37680]: pgmap v746: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:45:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:16 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:16 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi047 to 3249M 2024-04-06T03:45:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:16 smithi102 ceph-mon[32821]: Adjusting osd_memory_target on smithi102 to 3248M 2024-04-06T03:45:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:16 smithi102 ceph-mon[32821]: pgmap v746: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-06T03:45:16.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:16 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:18.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:18 smithi047 ceph-mon[29365]: pgmap v747: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-06T03:45:18.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:18 smithi047 ceph-mon[37680]: pgmap v747: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-06T03:45:18.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:18 smithi102 ceph-mon[32821]: pgmap v747: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-06T03:45:19.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:19.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:20 smithi047 ceph-mon[29365]: pgmap v748: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 982 B/s wr, 4 op/s 2024-04-06T03:45:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:20 smithi047 ceph-mon[37680]: pgmap v748: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 982 B/s wr, 4 op/s 2024-04-06T03:45:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:20 smithi102 ceph-mon[32821]: pgmap v748: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 982 B/s wr, 4 op/s 2024-04-06T03:45:21.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:21 smithi047 ceph-mon[29365]: pgmap v749: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-04-06T03:45:21.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:21 smithi047 ceph-mon[37680]: pgmap v749: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-04-06T03:45:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:21 smithi102 ceph-mon[32821]: pgmap v749: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-04-06T03:45:22.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:45:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:45:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:23 smithi047 ceph-mon[29365]: osdmap e494: 8 total, 8 up, 8 in 2024-04-06T03:45:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:23.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:23 smithi047 ceph-mon[29365]: pgmap v751: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:45:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:23 smithi047 ceph-mon[37680]: osdmap e494: 8 total, 8 up, 8 in 2024-04-06T03:45:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:23.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:23 smithi047 ceph-mon[37680]: pgmap v751: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:45:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:23 smithi102 ceph-mon[32821]: osdmap e494: 8 total, 8 up, 8 in 2024-04-06T03:45:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:23.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:23 smithi102 ceph-mon[32821]: pgmap v751: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:45:24.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:45:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:45:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:45:25.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:25 smithi047 ceph-mon[29365]: pgmap v752: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:45:25.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:25 smithi047 ceph-mon[37680]: pgmap v752: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:45:26.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:25 smithi102 ceph-mon[32821]: pgmap v752: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:45:27.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:27 smithi047 ceph-mon[29365]: pgmap v753: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:27.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:27 smithi047 ceph-mon[37680]: pgmap v753: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:28.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:27 smithi102 ceph-mon[32821]: pgmap v753: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:29.887 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:29 smithi102 ceph-mon[32821]: pgmap v754: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:29.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:29 smithi047 ceph-mon[29365]: pgmap v754: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:29.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:29 smithi047 ceph-mon[37680]: pgmap v754: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:30.585 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:45:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=cleanup t=2024-04-06T03:45:30.204503528Z level=info msg="Completed cleanup jobs" duration=4.448691ms 2024-04-06T03:45:30.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:30 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.17", "id": [0, 1]}]: dispatch 2024-04-06T03:45:30.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:30 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.17", "id": [0, 1]}]: dispatch 2024-04-06T03:45:31.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:30 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.17", "id": [0, 1]}]: dispatch 2024-04-06T03:45:31.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:31 smithi047 ceph-mon[29365]: pgmap v755: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:31.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:31 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.17", "id": [0, 1]}]': finished 2024-04-06T03:45:31.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:31 smithi047 ceph-mon[29365]: osdmap e495: 8 total, 8 up, 8 in 2024-04-06T03:45:31.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:31 smithi047 ceph-mon[29365]: osdmap e496: 8 total, 8 up, 8 in 2024-04-06T03:45:31.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:31 smithi047 ceph-mon[37680]: pgmap v755: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:31.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:31 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.17", "id": [0, 1]}]': finished 2024-04-06T03:45:31.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:31 smithi047 ceph-mon[37680]: osdmap e495: 8 total, 8 up, 8 in 2024-04-06T03:45:31.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:31 smithi047 ceph-mon[37680]: osdmap e496: 8 total, 8 up, 8 in 2024-04-06T03:45:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:31 smithi102 ceph-mon[32821]: pgmap v755: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:31 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.17", "id": [0, 1]}]': finished 2024-04-06T03:45:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:31 smithi102 ceph-mon[32821]: osdmap e495: 8 total, 8 up, 8 in 2024-04-06T03:45:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:31 smithi102 ceph-mon[32821]: osdmap e496: 8 total, 8 up, 8 in 2024-04-06T03:45:32.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:45:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:45:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-94"}]: dispatch 2024-04-06T03:45:32.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:32 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-94"}]: dispatch 2024-04-06T03:45:32.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:32.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:32.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-94"}]: dispatch 2024-04-06T03:45:32.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:32 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-94"}]: dispatch 2024-04-06T03:45:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-94"}]: dispatch 2024-04-06T03:45:33.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:32 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-94"}]: dispatch 2024-04-06T03:45:33.994 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:45:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:45:33.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:33.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-mon[29365]: pgmap v758: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:33.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-mon[29365]: osdmap e497: 8 total, 8 up, 8 in 2024-04-06T03:45:33.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-mon[37680]: pgmap v758: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-mon[37680]: osdmap e497: 8 total, 8 up, 8 in 2024-04-06T03:45:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:33 smithi102 ceph-mon[32821]: pgmap v758: 260 pgs: 260 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:33 smithi102 ceph-mon[32821]: osdmap e497: 8 total, 8 up, 8 in 2024-04-06T03:45:34.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:34 smithi047 ceph-mon[29365]: osdmap e498: 8 total, 8 up, 8 in 2024-04-06T03:45:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:34.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:34 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:34.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:34 smithi047 ceph-mon[37680]: osdmap e498: 8 total, 8 up, 8 in 2024-04-06T03:45:34.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:34.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:34 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:34 smithi102 ceph-mon[32821]: osdmap e498: 8 total, 8 up, 8 in 2024-04-06T03:45:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:34 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:35.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[29365]: pgmap v761: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:35.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:35.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:35.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[29365]: osdmap e499: 8 total, 8 up, 8 in 2024-04-06T03:45:35.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:35.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[37680]: pgmap v761: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:35.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:35.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:35.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[37680]: osdmap e499: 8 total, 8 up, 8 in 2024-04-06T03:45:35.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:35 smithi102 ceph-mon[32821]: pgmap v761: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:35 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:35 smithi102 ceph-mon[32821]: osdmap e499: 8 total, 8 up, 8 in 2024-04-06T03:45:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:45:36.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:36 smithi047 ceph-mon[29365]: osdmap e500: 8 total, 8 up, 8 in 2024-04-06T03:45:36.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:36 smithi047 ceph-mon[37680]: osdmap e500: 8 total, 8 up, 8 in 2024-04-06T03:45:37.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:36 smithi102 ceph-mon[32821]: osdmap e500: 8 total, 8 up, 8 in 2024-04-06T03:45:37.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:37 smithi047 ceph-mon[29365]: pgmap v764: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:37.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:37 smithi047 ceph-mon[37680]: pgmap v764: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:38.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:37 smithi102 ceph-mon[32821]: pgmap v764: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:39 smithi047 ceph-mon[29365]: pgmap v765: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 1.0 KiB/s wr, 2 op/s 2024-04-06T03:45:39.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:39 smithi047 ceph-mon[37680]: pgmap v765: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 1.0 KiB/s wr, 2 op/s 2024-04-06T03:45:40.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:39 smithi102 ceph-mon[32821]: pgmap v765: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 1.0 KiB/s wr, 2 op/s 2024-04-06T03:45:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:41 smithi047 ceph-mon[29365]: pgmap v766: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 740 B/s rd, 888 B/s wr, 2 op/s 2024-04-06T03:45:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:41 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:41.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:41 smithi047 ceph-mon[37680]: pgmap v766: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 740 B/s rd, 888 B/s wr, 2 op/s 2024-04-06T03:45:41.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:41 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:41 smithi102 ceph-mon[32821]: pgmap v766: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 740 B/s rd, 888 B/s wr, 2 op/s 2024-04-06T03:45:42.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:41 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:42.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:45:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:45:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:43 smithi047 ceph-mon[29365]: pgmap v767: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:45:43.995 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:45:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:45:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:45:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:43.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:43 smithi047 ceph-mon[37680]: pgmap v767: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:45:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:44.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:43 smithi102 ceph-mon[32821]: pgmap v767: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-06T03:45:45.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:45 smithi047 ceph-mon[29365]: pgmap v768: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 619 B/s wr, 2 op/s 2024-04-06T03:45:45.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:45 smithi047 ceph-mon[37680]: pgmap v768: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 619 B/s wr, 2 op/s 2024-04-06T03:45:45.995 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 03:45:45 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2[53300]: 2024-04-06T03:45:45.664+0000 7feea3da8700 -1 snap_mapper.add_oid found existing snaps mapped on 104:f6ff321f:test-rados-api-smithi047-74676-97::foo:21, removing 2024-04-06T03:45:45.995 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 03:45:45 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3[59401]: 2024-04-06T03:45:45.664+0000 7f29f1ef3700 -1 snap_mapper.add_oid found existing snaps mapped on 104:f6ff321f:test-rados-api-smithi047-74676-97::foo:21, removing 2024-04-06T03:45:46.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:45 smithi102 ceph-mon[32821]: pgmap v768: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 619 B/s wr, 2 op/s 2024-04-06T03:45:46.085 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 03:45:45 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T03:45:45.664+0000 7f78fdf2b700 -1 snap_mapper.add_oid found existing snaps mapped on 104:f6ff321f:test-rados-api-smithi047-74676-97::foo:21, removing 2024-04-06T03:45:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-96"}]: dispatch 2024-04-06T03:45:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-96"}]: dispatch 2024-04-06T03:45:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-96"}]: dispatch 2024-04-06T03:45:46.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-96"}]: dispatch 2024-04-06T03:45:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-96"}]: dispatch 2024-04-06T03:45:47.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-96"}]: dispatch 2024-04-06T03:45:47.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:47 smithi047 ceph-mon[37680]: pgmap v769: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 656 B/s wr, 3 op/s 2024-04-06T03:45:47.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:47 smithi047 ceph-mon[37680]: osdmap e501: 8 total, 8 up, 8 in 2024-04-06T03:45:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:47 smithi047 ceph-mon[29365]: pgmap v769: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 656 B/s wr, 3 op/s 2024-04-06T03:45:47.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:47 smithi047 ceph-mon[29365]: osdmap e501: 8 total, 8 up, 8 in 2024-04-06T03:45:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:47 smithi102 ceph-mon[32821]: pgmap v769: 260 pgs: 260 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 656 B/s wr, 3 op/s 2024-04-06T03:45:48.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:47 smithi102 ceph-mon[32821]: osdmap e501: 8 total, 8 up, 8 in 2024-04-06T03:45:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:48 smithi047 ceph-mon[29365]: osdmap e502: 8 total, 8 up, 8 in 2024-04-06T03:45:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:48 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:48.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:48 smithi047 ceph-mon[37680]: osdmap e502: 8 total, 8 up, 8 in 2024-04-06T03:45:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:48 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:48.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:48 smithi102 ceph-mon[32821]: osdmap e502: 8 total, 8 up, 8 in 2024-04-06T03:45:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:48 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:45:49.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:45:49.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[29365]: pgmap v772: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[29365]: osdmap e503: 8 total, 8 up, 8 in 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[37680]: pgmap v772: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[37680]: osdmap e503: 8 total, 8 up, 8 in 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:45:49.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:45:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:49 smithi102 ceph-mon[32821]: pgmap v772: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 op/s 2024-04-06T03:45:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:49 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:45:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:49 smithi102 ceph-mon[32821]: osdmap e503: 8 total, 8 up, 8 in 2024-04-06T03:45:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:45:50.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:45:50.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:45:50.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:50 smithi047 ceph-mon[29365]: osdmap e504: 8 total, 8 up, 8 in 2024-04-06T03:45:50.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]: dispatch 2024-04-06T03:45:50.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]: dispatch 2024-04-06T03:45:50.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:45:50.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:50 smithi047 ceph-mon[37680]: osdmap e504: 8 total, 8 up, 8 in 2024-04-06T03:45:50.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]: dispatch 2024-04-06T03:45:50.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]: dispatch 2024-04-06T03:45:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:45:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:50 smithi102 ceph-mon[32821]: osdmap e504: 8 total, 8 up, 8 in 2024-04-06T03:45:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]: dispatch 2024-04-06T03:45:51.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]: dispatch 2024-04-06T03:45:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[29365]: pgmap v775: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]': finished 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[29365]: osdmap e505: 8 total, 8 up, 8 in 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[37680]: pgmap v775: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]': finished 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[37680]: osdmap e505: 8 total, 8 up, 8 in 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:51.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:51 smithi102 ceph-mon[32821]: pgmap v775: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:45:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:51 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:45:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-98", "mode": "writeback"}]': finished 2024-04-06T03:45:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:51 smithi102 ceph-mon[32821]: osdmap e505: 8 total, 8 up, 8 in 2024-04-06T03:45:52.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:52.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:52.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:45:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:45:52.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]': finished 2024-04-06T03:45:52.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[29365]: osdmap e506: 8 total, 8 up, 8 in 2024-04-06T03:45:52.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:45:52.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:45:52.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:45:52.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:45:52.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[29365]: osdmap e507: 8 total, 8 up, 8 in 2024-04-06T03:45:52.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]': finished 2024-04-06T03:45:52.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[37680]: osdmap e506: 8 total, 8 up, 8 in 2024-04-06T03:45:52.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:45:52.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:45:52.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:45:52.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:45:52.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:52 smithi047 ceph-mon[37680]: osdmap e507: 8 total, 8 up, 8 in 2024-04-06T03:45:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-98"}]': finished 2024-04-06T03:45:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:52 smithi102 ceph-mon[32821]: osdmap e506: 8 total, 8 up, 8 in 2024-04-06T03:45:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:45:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:45:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:52 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:45:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:45:53.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:52 smithi102 ceph-mon[32821]: osdmap e507: 8 total, 8 up, 8 in 2024-04-06T03:45:53.994 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:45:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:45:53.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:53.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[29365]: pgmap v778: 260 pgs: 260 active+clean; 8.4 MiB data, 664 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]': finished 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[29365]: osdmap e508: 8 total, 8 up, 8 in 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[37680]: pgmap v778: 260 pgs: 260 active+clean; 8.4 MiB data, 664 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-06T03:45:53.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-06T03:45:53.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]': finished 2024-04-06T03:45:53.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[37680]: osdmap e508: 8 total, 8 up, 8 in 2024-04-06T03:45:53.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:45:53.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:45:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:45:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:53 smithi102 ceph-mon[32821]: pgmap v778: 260 pgs: 260 active+clean; 8.4 MiB data, 664 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:45:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-06T03:45:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-06T03:45:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_count","val": "1"}]': finished 2024-04-06T03:45:54.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:53 smithi102 ceph-mon[32821]: osdmap e508: 8 total, 8 up, 8 in 2024-04-06T03:45:54.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:45:54.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:45:55.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[29365]: pgmap v781: 260 pgs: 260 active+clean; 8.4 MiB data, 664 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:45:55.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:45:55.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[29365]: osdmap e509: 8 total, 8 up, 8 in 2024-04-06T03:45:55.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-06T03:45:55.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-06T03:45:55.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[37680]: pgmap v781: 260 pgs: 260 active+clean; 8.4 MiB data, 664 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:45:55.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:45:55.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[37680]: osdmap e509: 8 total, 8 up, 8 in 2024-04-06T03:45:55.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-06T03:45:55.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-06T03:45:56.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:55 smithi102 ceph-mon[32821]: pgmap v781: 260 pgs: 260 active+clean; 8.4 MiB data, 664 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:45:56.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:45:56.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:55 smithi102 ceph-mon[32821]: osdmap e509: 8 total, 8 up, 8 in 2024-04-06T03:45:56.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-06T03:45:56.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-06T03:45:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]': finished 2024-04-06T03:45:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[29365]: osdmap e510: 8 total, 8 up, 8 in 2024-04-06T03:45:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:56.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:56.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]': finished 2024-04-06T03:45:56.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[37680]: osdmap e510: 8 total, 8 up, 8 in 2024-04-06T03:45:56.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:56.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:56.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:56 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:57.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-98","var": "target_max_objects","val": "250"}]': finished 2024-04-06T03:45:57.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:56 smithi102 ceph-mon[32821]: osdmap e510: 8 total, 8 up, 8 in 2024-04-06T03:45:57.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:57.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:45:57.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:56 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:45:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[29365]: pgmap v784: 260 pgs: 260 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:45:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[29365]: osdmap e511: 8 total, 8 up, 8 in 2024-04-06T03:45:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[37680]: pgmap v784: 260 pgs: 260 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:45:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[37680]: osdmap e511: 8 total, 8 up, 8 in 2024-04-06T03:45:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:57.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:58.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:57 smithi102 ceph-mon[32821]: pgmap v784: 260 pgs: 260 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:58.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:45:58.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:57 smithi102 ceph-mon[32821]: osdmap e511: 8 total, 8 up, 8 in 2024-04-06T03:45:58.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:58.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]: dispatch 2024-04-06T03:45:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]': finished 2024-04-06T03:45:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:58 smithi047 ceph-mon[29365]: osdmap e512: 8 total, 8 up, 8 in 2024-04-06T03:45:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]': finished 2024-04-06T03:45:58.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:58 smithi047 ceph-mon[37680]: osdmap e512: 8 total, 8 up, 8 in 2024-04-06T03:45:59.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-98"}]': finished 2024-04-06T03:45:59.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:58 smithi102 ceph-mon[32821]: osdmap e512: 8 total, 8 up, 8 in 2024-04-06T03:45:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:59 smithi047 ceph-mon[29365]: pgmap v787: 260 pgs: 260 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:45:59 smithi047 ceph-mon[29365]: osdmap e513: 8 total, 8 up, 8 in 2024-04-06T03:45:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:59 smithi047 ceph-mon[37680]: pgmap v787: 260 pgs: 260 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:45:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:45:59 smithi047 ceph-mon[37680]: osdmap e513: 8 total, 8 up, 8 in 2024-04-06T03:46:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:59 smithi102 ceph-mon[32821]: pgmap v787: 260 pgs: 260 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:45:59 smithi102 ceph-mon[32821]: osdmap e513: 8 total, 8 up, 8 in 2024-04-06T03:46:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:00 smithi102 ceph-mon[32821]: osdmap e514: 8 total, 8 up, 8 in 2024-04-06T03:46:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:01.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:00 smithi102 ceph-mon[32821]: osdmap e515: 8 total, 8 up, 8 in 2024-04-06T03:46:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[29365]: osdmap e514: 8 total, 8 up, 8 in 2024-04-06T03:46:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[29365]: osdmap e515: 8 total, 8 up, 8 in 2024-04-06T03:46:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[37680]: osdmap e514: 8 total, 8 up, 8 in 2024-04-06T03:46:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:01.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:00 smithi047 ceph-mon[37680]: osdmap e515: 8 total, 8 up, 8 in 2024-04-06T03:46:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:01 smithi102 ceph-mon[32821]: pgmap v790: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:46:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:46:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:01 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:46:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:01 smithi102 ceph-mon[32821]: osdmap e516: 8 total, 8 up, 8 in 2024-04-06T03:46:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[29365]: pgmap v790: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:46:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:46:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:46:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[29365]: osdmap e516: 8 total, 8 up, 8 in 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[37680]: pgmap v790: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[37680]: osdmap e516: 8 total, 8 up, 8 in 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:02.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:02.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:46:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:46:03.994 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:46:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[29365]: pgmap v793: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]': finished 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[29365]: osdmap e517: 8 total, 8 up, 8 in 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]: dispatch 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]: dispatch 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[37680]: pgmap v793: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:03.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]': finished 2024-04-06T03:46:03.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[37680]: osdmap e517: 8 total, 8 up, 8 in 2024-04-06T03:46:03.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]: dispatch 2024-04-06T03:46:03.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]: dispatch 2024-04-06T03:46:03.996 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:03 smithi102 ceph-mon[32821]: pgmap v793: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-6", "overlaypool": "test-rados-api-smithi047-74676-100"}]': finished 2024-04-06T03:46:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:03 smithi102 ceph-mon[32821]: osdmap e517: 8 total, 8 up, 8 in 2024-04-06T03:46:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]: dispatch 2024-04-06T03:46:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]: dispatch 2024-04-06T03:46:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:04 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]': finished 2024-04-06T03:46:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:04 smithi102 ceph-mon[32821]: osdmap e518: 8 total, 8 up, 8 in 2024-04-06T03:46:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:46:05.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:04 smithi102 ceph-mon[32821]: osdmap e519: 8 total, 8 up, 8 in 2024-04-06T03:46:05.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:05.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]': finished 2024-04-06T03:46:05.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[37680]: osdmap e518: 8 total, 8 up, 8 in 2024-04-06T03:46:05.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:05.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:05.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:46:05.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[37680]: osdmap e519: 8 total, 8 up, 8 in 2024-04-06T03:46:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-100", "mode": "writeback"}]': finished 2024-04-06T03:46:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[29365]: osdmap e518: 8 total, 8 up, 8 in 2024-04-06T03:46:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:46:05.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:04 smithi047 ceph-mon[29365]: osdmap e519: 8 total, 8 up, 8 in 2024-04-06T03:46:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:05 smithi102 ceph-mon[32821]: pgmap v796: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:46:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:05 smithi102 ceph-mon[32821]: osdmap e520: 8 total, 8 up, 8 in 2024-04-06T03:46:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:06.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[37680]: pgmap v796: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:46:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[37680]: osdmap e520: 8 total, 8 up, 8 in 2024-04-06T03:46:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:06.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[29365]: pgmap v796: 260 pgs: 260 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:46:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[29365]: osdmap e520: 8 total, 8 up, 8 in 2024-04-06T03:46:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:06.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:06.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:06 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:06 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:46:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:06 smithi102 ceph-mon[32821]: osdmap e521: 8 total, 8 up, 8 in 2024-04-06T03:46:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-06T03:46:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-06T03:46:07.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:07.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:46:07.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[29365]: osdmap e521: 8 total, 8 up, 8 in 2024-04-06T03:46:07.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-06T03:46:07.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-06T03:46:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:46:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[37680]: osdmap e521: 8 total, 8 up, 8 in 2024-04-06T03:46:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-06T03:46:07.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-06T03:46:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:07 smithi102 ceph-mon[32821]: pgmap v799: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-04-06T03:46:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:07 smithi102 ceph-mon[32821]: osdmap e522: 8 total, 8 up, 8 in 2024-04-06T03:46:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:07 smithi047 ceph-mon[29365]: pgmap v799: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-04-06T03:46:08.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:07 smithi047 ceph-mon[29365]: osdmap e522: 8 total, 8 up, 8 in 2024-04-06T03:46:08.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:07 smithi047 ceph-mon[37680]: pgmap v799: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-04-06T03:46:08.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:07 smithi047 ceph-mon[37680]: osdmap e522: 8 total, 8 up, 8 in 2024-04-06T03:46:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:09.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:08 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:09.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:09.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:08 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:09.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:09.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:08 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:09 smithi102 ceph-mon[32821]: pgmap v802: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:46:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:09 smithi102 ceph-mon[32821]: osdmap e523: 8 total, 8 up, 8 in 2024-04-06T03:46:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:10.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:09 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:10.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[29365]: pgmap v802: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:10.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:46:10.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[29365]: osdmap e523: 8 total, 8 up, 8 in 2024-04-06T03:46:10.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:10.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[37680]: pgmap v802: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]': finished 2024-04-06T03:46:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[37680]: osdmap e523: 8 total, 8 up, 8 in 2024-04-06T03:46:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:10.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:09 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]: dispatch 2024-04-06T03:46:11.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:10 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]': finished 2024-04-06T03:46:11.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:10 smithi102 ceph-mon[32821]: osdmap e524: 8 total, 8 up, 8 in 2024-04-06T03:46:11.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:10 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]': finished 2024-04-06T03:46:11.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:10 smithi047 ceph-mon[29365]: osdmap e524: 8 total, 8 up, 8 in 2024-04-06T03:46:11.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:10 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-100"}]': finished 2024-04-06T03:46:11.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:10 smithi047 ceph-mon[37680]: osdmap e524: 8 total, 8 up, 8 in 2024-04-06T03:46:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:11 smithi102 ceph-mon[32821]: pgmap v805: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:12.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:11 smithi102 ceph-mon[32821]: osdmap e525: 8 total, 8 up, 8 in 2024-04-06T03:46:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:11 smithi047 ceph-mon[29365]: pgmap v805: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:12.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:11 smithi047 ceph-mon[29365]: osdmap e525: 8 total, 8 up, 8 in 2024-04-06T03:46:12.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:11 smithi047 ceph-mon[37680]: pgmap v805: 260 pgs: 260 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:12.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:11 smithi047 ceph-mon[37680]: osdmap e525: 8 total, 8 up, 8 in 2024-04-06T03:46:12.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:46:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:46:13.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:12 smithi102 ceph-mon[32821]: osdmap e526: 8 total, 8 up, 8 in 2024-04-06T03:46:13.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:13.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:12 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:13.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:12 smithi047 ceph-mon[29365]: osdmap e526: 8 total, 8 up, 8 in 2024-04-06T03:46:13.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:13.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:12 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:13.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:12 smithi047 ceph-mon[37680]: osdmap e526: 8 total, 8 up, 8 in 2024-04-06T03:46:13.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:13.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:12 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:13 smithi102 ceph-mon[32821]: pgmap v808: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:13 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:13 smithi102 ceph-mon[32821]: osdmap e527: 8 total, 8 up, 8 in 2024-04-06T03:46:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:46:14.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:46:14.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:13 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:46:14.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:46:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:46:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[37680]: pgmap v808: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[37680]: osdmap e527: 8 total, 8 up, 8 in 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[29365]: pgmap v808: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[29365]: osdmap e527: 8 total, 8 up, 8 in 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-06T03:46:14.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:46:14.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:13 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-06T03:46:15.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:46:15.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:14 smithi102 ceph-mon[32821]: osdmap e528: 8 total, 8 up, 8 in 2024-04-06T03:46:15.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:46:15.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:14 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:46:15.087 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:14 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:46:15.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:46:15.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[29365]: osdmap e528: 8 total, 8 up, 8 in 2024-04-06T03:46:15.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:46:15.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:46:15.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:46:15.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-06T03:46:15.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[37680]: osdmap e528: 8 total, 8 up, 8 in 2024-04-06T03:46:15.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:46:15.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-06T03:46:15.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:14 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:46:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:15 smithi102 ceph-mon[32821]: pgmap v811: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:46:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:15 smithi102 ceph-mon[32821]: osdmap e529: 8 total, 8 up, 8 in 2024-04-06T03:46:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:46:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:15 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:46:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:46:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:46:16.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:15 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:46:16.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[29365]: pgmap v811: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:16.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:46:16.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[29365]: osdmap e529: 8 total, 8 up, 8 in 2024-04-06T03:46:16.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:46:16.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:46:16.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[37680]: pgmap v811: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[37680]: osdmap e529: 8 total, 8 up, 8 in 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:46:16.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:15 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:46:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:46:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:16 smithi102 ceph-mon[32821]: osdmap e530: 8 total, 8 up, 8 in 2024-04-06T03:46:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-102"}]: dispatch 2024-04-06T03:46:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:16 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-102"}]: dispatch 2024-04-06T03:46:17.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:46:17.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[29365]: osdmap e530: 8 total, 8 up, 8 in 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-102"}]: dispatch 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-102"}]: dispatch 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[37680]: osdmap e530: 8 total, 8 up, 8 in 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-6"}]: dispatch 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3450962985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-102"}]: dispatch 2024-04-06T03:46:17.247 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:16 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-6", "tierpool": "test-rados-api-smithi047-74676-102"}]: dispatch 2024-04-06T03:46:18.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:17 smithi102 ceph-mon[32821]: pgmap v814: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-06T03:46:18.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:17 smithi102 ceph-mon[32821]: osdmap e531: 8 total, 8 up, 8 in 2024-04-06T03:46:18.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:17 smithi047 ceph-mon[29365]: pgmap v814: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-06T03:46:18.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:17 smithi047 ceph-mon[29365]: osdmap e531: 8 total, 8 up, 8 in 2024-04-06T03:46:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:17 smithi047 ceph-mon[37680]: pgmap v814: 260 pgs: 260 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-06T03:46:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:17 smithi047 ceph-mon[37680]: osdmap e531: 8 total, 8 up, 8 in 2024-04-06T03:46:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[29365]: osdmap e532: 8 total, 8 up, 8 in 2024-04-06T03:46:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[37680]: osdmap e532: 8 total, 8 up, 8 in 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:19.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:18 smithi102 ceph-mon[32821]: osdmap e532: 8 total, 8 up, 8 in 2024-04-06T03:46:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:18 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:19.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[29365]: pgmap v817: 196 pgs: 196 active+clean; 582 KiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[29365]: osdmap e533: 8 total, 8 up, 8 in 2024-04-06T03:46:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[37680]: pgmap v817: 196 pgs: 196 active+clean; 582 KiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:20.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:20.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[37680]: osdmap e533: 8 total, 8 up, 8 in 2024-04-06T03:46:20.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:20.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:19 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:19 smithi102 ceph-mon[32821]: pgmap v817: 196 pgs: 196 active+clean; 582 KiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:19 smithi102 ceph-mon[32821]: osdmap e533: 8 total, 8 up, 8 in 2024-04-06T03:46:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:19 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:20 smithi047 ceph-mon[29365]: osdmap e534: 8 total, 8 up, 8 in 2024-04-06T03:46:21.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:20 smithi047 ceph-mon[37680]: osdmap e534: 8 total, 8 up, 8 in 2024-04-06T03:46:21.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:20 smithi102 ceph-mon[32821]: osdmap e534: 8 total, 8 up, 8 in 2024-04-06T03:46:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:21 smithi047 ceph-mon[37680]: pgmap v820: 196 pgs: 196 active+clean; 582 KiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:21 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:21 smithi047 ceph-mon[37680]: osdmap e535: 8 total, 8 up, 8 in 2024-04-06T03:46:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:21 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:21 smithi047 ceph-mon[29365]: pgmap v820: 196 pgs: 196 active+clean; 582 KiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:21 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:22.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:21 smithi047 ceph-mon[29365]: osdmap e535: 8 total, 8 up, 8 in 2024-04-06T03:46:22.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:21 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:22.307 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:21 smithi102 ceph-mon[32821]: pgmap v820: 196 pgs: 196 active+clean; 582 KiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:22.307 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:21 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi047-74676-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:22.308 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:21 smithi102 ceph-mon[32821]: osdmap e535: 8 total, 8 up, 8 in 2024-04-06T03:46:22.308 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:21 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:22.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:46:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:46:23.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:22 smithi047 ceph-mon[29365]: osdmap e536: 8 total, 8 up, 8 in 2024-04-06T03:46:23.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:22 smithi047 ceph-mon[37680]: osdmap e536: 8 total, 8 up, 8 in 2024-04-06T03:46:23.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:22 smithi102 ceph-mon[32821]: osdmap e536: 8 total, 8 up, 8 in 2024-04-06T03:46:24.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:46:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:46:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[37680]: pgmap v823: 204 pgs: 8 creating+peering, 196 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[37680]: osdmap e537: 8 total, 8 up, 8 in 2024-04-06T03:46:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:24.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[29365]: pgmap v823: 204 pgs: 8 creating+peering, 196 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[29365]: osdmap e537: 8 total, 8 up, 8 in 2024-04-06T03:46:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:24.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:23 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:23 smithi102 ceph-mon[32821]: pgmap v823: 204 pgs: 8 creating+peering, 196 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:23 smithi102 ceph-mon[32821]: osdmap e537: 8 total, 8 up, 8 in 2024-04-06T03:46:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:24.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:23 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:25.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:25.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[29365]: osdmap e538: 8 total, 8 up, 8 in 2024-04-06T03:46:25.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[29365]: osdmap e539: 8 total, 8 up, 8 in 2024-04-06T03:46:25.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:25.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:25.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:25.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[37680]: osdmap e538: 8 total, 8 up, 8 in 2024-04-06T03:46:25.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[37680]: osdmap e539: 8 total, 8 up, 8 in 2024-04-06T03:46:25.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:25.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:24 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:25.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:25.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:24 smithi102 ceph-mon[32821]: osdmap e538: 8 total, 8 up, 8 in 2024-04-06T03:46:25.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:24 smithi102 ceph-mon[32821]: osdmap e539: 8 total, 8 up, 8 in 2024-04-06T03:46:25.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:25.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:24 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:26.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[37680]: pgmap v826: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:26.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:26.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[37680]: osdmap e540: 8 total, 8 up, 8 in 2024-04-06T03:46:26.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:26.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[29365]: pgmap v826: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[29365]: osdmap e540: 8 total, 8 up, 8 in 2024-04-06T03:46:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:26.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:25 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:26.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:25 smithi102 ceph-mon[32821]: pgmap v826: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:25 smithi102 ceph-mon[32821]: osdmap e540: 8 total, 8 up, 8 in 2024-04-06T03:46:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:26.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:25 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:27.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:27.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:27.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[29365]: osdmap e541: 8 total, 8 up, 8 in 2024-04-06T03:46:27.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:27.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:27.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:27.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:27.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[37680]: osdmap e541: 8 total, 8 up, 8 in 2024-04-06T03:46:27.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:27.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:26 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:26 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:26 smithi102 ceph-mon[32821]: osdmap e541: 8 total, 8 up, 8 in 2024-04-06T03:46:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:26 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:27.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:26 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[37680]: pgmap v829: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[37680]: osdmap e542: 8 total, 8 up, 8 in 2024-04-06T03:46:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:28.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[29365]: pgmap v829: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[29365]: osdmap e542: 8 total, 8 up, 8 in 2024-04-06T03:46:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:28.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:27 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:28.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:27 smithi102 ceph-mon[32821]: pgmap v829: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-107", "overlaypool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:27 smithi102 ceph-mon[32821]: osdmap e542: 8 total, 8 up, 8 in 2024-04-06T03:46:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:27 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:28.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:27 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:29.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:28 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:29.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]': finished 2024-04-06T03:46:29.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:28 smithi102 ceph-mon[32821]: osdmap e543: 8 total, 8 up, 8 in 2024-04-06T03:46:29.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:28 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]: dispatch 2024-04-06T03:46:29.236 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:28 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]: dispatch 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]': finished 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[37680]: osdmap e543: 8 total, 8 up, 8 in 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]: dispatch 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]: dispatch 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-107-cache", "mode": "writeback"}]': finished 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[29365]: osdmap e543: 8 total, 8 up, 8 in 2024-04-06T03:46:29.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]: dispatch 2024-04-06T03:46:29.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:28 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]: dispatch 2024-04-06T03:46:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[29365]: pgmap v832: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]': finished 2024-04-06T03:46:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[29365]: osdmap e544: 8 total, 8 up, 8 in 2024-04-06T03:46:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:30.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:30.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[37680]: pgmap v832: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]': finished 2024-04-06T03:46:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[37680]: osdmap e544: 8 total, 8 up, 8 in 2024-04-06T03:46:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:30.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:29 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:29 smithi102 ceph-mon[32821]: pgmap v832: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:46:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-107"}]': finished 2024-04-06T03:46:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:29 smithi102 ceph-mon[32821]: osdmap e544: 8 total, 8 up, 8 in 2024-04-06T03:46:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2927675336' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:30.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:29 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]: dispatch 2024-04-06T03:46:31.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:30 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:31.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:30 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:31.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:30 smithi047 ceph-mon[29365]: osdmap e545: 8 total, 8 up, 8 in 2024-04-06T03:46:31.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:30 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:31.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:30 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:31.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:30 smithi047 ceph-mon[37680]: osdmap e545: 8 total, 8 up, 8 in 2024-04-06T03:46:31.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:30 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:30 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-107", "tierpool": "test-rados-api-smithi047-74676-107-cache"}]': finished 2024-04-06T03:46:31.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:30 smithi102 ceph-mon[32821]: osdmap e545: 8 total, 8 up, 8 in 2024-04-06T03:46:32.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:31 smithi047 ceph-mon[37680]: pgmap v835: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:32.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:31 smithi047 ceph-mon[37680]: osdmap e546: 8 total, 8 up, 8 in 2024-04-06T03:46:32.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:31 smithi047 ceph-mon[29365]: pgmap v835: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:32.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:31 smithi047 ceph-mon[29365]: osdmap e546: 8 total, 8 up, 8 in 2024-04-06T03:46:32.315 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:31 smithi102 ceph-mon[32821]: pgmap v835: 268 pgs: 268 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:32.315 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:31 smithi102 ceph-mon[32821]: osdmap e546: 8 total, 8 up, 8 in 2024-04-06T03:46:32.584 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:46:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:46:34.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:46:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:46:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: pgmap v838: 236 pgs: 236 active+clean; 582 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: osdmap e547: 8 total, 8 up, 8 in 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: pgmap v838: 236 pgs: 236 active+clean; 582 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: osdmap e547: 8 total, 8 up, 8 in 2024-04-06T03:46:34.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:34.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: pgmap v838: 236 pgs: 236 active+clean; 582 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: osdmap e547: 8 total, 8 up, 8 in 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:34.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:35.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:35.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:35 smithi047 ceph-mon[37680]: osdmap e548: 8 total, 8 up, 8 in 2024-04-06T03:46:35.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:35.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:35 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:35 smithi047 ceph-mon[29365]: osdmap e548: 8 total, 8 up, 8 in 2024-04-06T03:46:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:35 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:35 smithi102 ceph-mon[32821]: osdmap e548: 8 total, 8 up, 8 in 2024-04-06T03:46:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:35 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:36 smithi047 ceph-mon[29365]: pgmap v841: 204 pgs: 204 active+clean; 582 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:36 smithi047 ceph-mon[29365]: osdmap e549: 8 total, 8 up, 8 in 2024-04-06T03:46:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:36 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:36 smithi047 ceph-mon[29365]: osdmap e550: 8 total, 8 up, 8 in 2024-04-06T03:46:36.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:36 smithi047 ceph-mon[37680]: pgmap v841: 204 pgs: 204 active+clean; 582 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:36.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:36 smithi047 ceph-mon[37680]: osdmap e549: 8 total, 8 up, 8 in 2024-04-06T03:46:36.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:36 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:36.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:36 smithi047 ceph-mon[37680]: osdmap e550: 8 total, 8 up, 8 in 2024-04-06T03:46:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:36 smithi102 ceph-mon[32821]: pgmap v841: 204 pgs: 204 active+clean; 582 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:36 smithi102 ceph-mon[32821]: osdmap e549: 8 total, 8 up, 8 in 2024-04-06T03:46:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:36 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:36 smithi102 ceph-mon[32821]: osdmap e550: 8 total, 8 up, 8 in 2024-04-06T03:46:38.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[37680]: pgmap v844: 212 pgs: 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:38.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[37680]: osdmap e551: 8 total, 8 up, 8 in 2024-04-06T03:46:38.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:38.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:38.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[29365]: pgmap v844: 212 pgs: 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[29365]: osdmap e551: 8 total, 8 up, 8 in 2024-04-06T03:46:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:38.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:37 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:37 smithi102 ceph-mon[32821]: pgmap v844: 212 pgs: 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:37 smithi102 ceph-mon[32821]: osdmap e551: 8 total, 8 up, 8 in 2024-04-06T03:46:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:37 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:38.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:37 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:39.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:39.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[29365]: osdmap e552: 8 total, 8 up, 8 in 2024-04-06T03:46:39.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:39.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[29365]: osdmap e553: 8 total, 8 up, 8 in 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[37680]: osdmap e552: 8 total, 8 up, 8 in 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[37680]: osdmap e553: 8 total, 8 up, 8 in 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:38 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:46:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:38 smithi102 ceph-mon[32821]: osdmap e552: 8 total, 8 up, 8 in 2024-04-06T03:46:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:38 smithi102 ceph-mon[32821]: osdmap e553: 8 total, 8 up, 8 in 2024-04-06T03:46:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:39.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:38 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[29365]: pgmap v847: 244 pgs: 32 unknown, 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[29365]: osdmap e554: 8 total, 8 up, 8 in 2024-04-06T03:46:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[37680]: pgmap v847: 244 pgs: 32 unknown, 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[37680]: osdmap e554: 8 total, 8 up, 8 in 2024-04-06T03:46:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:40.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:39 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:39 smithi102 ceph-mon[32821]: pgmap v847: 244 pgs: 32 unknown, 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-109", "overlaypool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:39 smithi102 ceph-mon[32821]: osdmap e554: 8 total, 8 up, 8 in 2024-04-06T03:46:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:39 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]: dispatch 2024-04-06T03:46:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]': finished 2024-04-06T03:46:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[37680]: osdmap e555: 8 total, 8 up, 8 in 2024-04-06T03:46:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:41.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:41.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]': finished 2024-04-06T03:46:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[29365]: osdmap e555: 8 total, 8 up, 8 in 2024-04-06T03:46:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:41.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:40 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:40 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:46:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-109-cache", "mode": "writeback"}]': finished 2024-04-06T03:46:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:40 smithi102 ceph-mon[32821]: osdmap e555: 8 total, 8 up, 8 in 2024-04-06T03:46:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:41.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:40 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:46:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[29365]: pgmap v850: 244 pgs: 32 unknown, 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:46:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[29365]: osdmap e556: 8 total, 8 up, 8 in 2024-04-06T03:46:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:42.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[37680]: pgmap v850: 244 pgs: 32 unknown, 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:46:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[37680]: osdmap e556: 8 total, 8 up, 8 in 2024-04-06T03:46:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:42.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:41 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:42.327 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:41 smithi102 ceph-mon[32821]: pgmap v850: 244 pgs: 32 unknown, 8 creating+peering, 204 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:42.327 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:46:42.327 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:41 smithi102 ceph-mon[32821]: osdmap e556: 8 total, 8 up, 8 in 2024-04-06T03:46:42.327 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:42.327 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:41 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:46:42.584 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:46:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:46:44.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:46:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:46:44.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:44.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[37680]: pgmap v853: 244 pgs: 244 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[37680]: osdmap e557: 8 total, 8 up, 8 in 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[29365]: pgmap v853: 244 pgs: 244 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[29365]: osdmap e557: 8 total, 8 up, 8 in 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:44.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:43 smithi102 ceph-mon[32821]: pgmap v853: 244 pgs: 244 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:46:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:43 smithi102 ceph-mon[32821]: osdmap e557: 8 total, 8 up, 8 in 2024-04-06T03:46:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:44.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:46:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:46:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[29365]: osdmap e558: 8 total, 8 up, 8 in 2024-04-06T03:46:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-06T03:46:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-06T03:46:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-04-06T03:46:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[29365]: osdmap e559: 8 total, 8 up, 8 in 2024-04-06T03:46:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:46:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[37680]: osdmap e558: 8 total, 8 up, 8 in 2024-04-06T03:46:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-06T03:46:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-06T03:46:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-04-06T03:46:45.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:44 smithi047 ceph-mon[37680]: osdmap e559: 8 total, 8 up, 8 in 2024-04-06T03:46:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:44 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:46:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:46:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:44 smithi102 ceph-mon[32821]: osdmap e558: 8 total, 8 up, 8 in 2024-04-06T03:46:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-06T03:46:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-06T03:46:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:44 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-04-06T03:46:45.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:44 smithi102 ceph-mon[32821]: osdmap e559: 8 total, 8 up, 8 in 2024-04-06T03:46:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:45 smithi047 ceph-mon[29365]: pgmap v856: 244 pgs: 244 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:46.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:45 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:45 smithi047 ceph-mon[37680]: pgmap v856: 244 pgs: 244 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:45 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:45 smithi102 ceph-mon[32821]: pgmap v856: 244 pgs: 244 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:46.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:45 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:47.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:47.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:46 smithi047 ceph-mon[29365]: osdmap e560: 8 total, 8 up, 8 in 2024-04-06T03:46:47.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:47.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:46 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:46 smithi047 ceph-mon[37680]: osdmap e560: 8 total, 8 up, 8 in 2024-04-06T03:46:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:47.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:46 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:46 smithi102 ceph-mon[32821]: osdmap e560: 8 total, 8 up, 8 in 2024-04-06T03:46:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:47.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:46 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]: dispatch 2024-04-06T03:46:48.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:47 smithi047 ceph-mon[29365]: pgmap v859: 244 pgs: 244 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:46:48.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:47 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:48.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:47 smithi047 ceph-mon[29365]: osdmap e561: 8 total, 8 up, 8 in 2024-04-06T03:46:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:47 smithi047 ceph-mon[37680]: pgmap v859: 244 pgs: 244 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:46:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:47 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:47 smithi047 ceph-mon[37680]: osdmap e561: 8 total, 8 up, 8 in 2024-04-06T03:46:48.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:47 smithi102 ceph-mon[32821]: pgmap v859: 244 pgs: 244 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:46:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:47 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-109", "tierpool": "test-rados-api-smithi047-74676-109-cache"}]': finished 2024-04-06T03:46:48.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:47 smithi102 ceph-mon[32821]: osdmap e561: 8 total, 8 up, 8 in 2024-04-06T03:46:49.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:48 smithi047 ceph-mon[29365]: osdmap e562: 8 total, 8 up, 8 in 2024-04-06T03:46:49.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:48 smithi047 ceph-mon[37680]: osdmap e562: 8 total, 8 up, 8 in 2024-04-06T03:46:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:49.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:48 smithi102 ceph-mon[32821]: osdmap e562: 8 total, 8 up, 8 in 2024-04-06T03:46:49.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:46:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:49 smithi047 ceph-mon[29365]: pgmap v862: 212 pgs: 212 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:46:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:49 smithi047 ceph-mon[29365]: osdmap e563: 8 total, 8 up, 8 in 2024-04-06T03:46:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:49 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:49 smithi047 ceph-mon[37680]: pgmap v862: 212 pgs: 212 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:46:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:49 smithi047 ceph-mon[37680]: osdmap e563: 8 total, 8 up, 8 in 2024-04-06T03:46:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:49 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:50.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:49 smithi102 ceph-mon[32821]: pgmap v862: 212 pgs: 212 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:46:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:49 smithi102 ceph-mon[32821]: osdmap e563: 8 total, 8 up, 8 in 2024-04-06T03:46:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:50.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:49 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:50 smithi047 ceph-mon[29365]: osdmap e564: 8 total, 8 up, 8 in 2024-04-06T03:46:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:50 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:50 smithi047 ceph-mon[37680]: osdmap e564: 8 total, 8 up, 8 in 2024-04-06T03:46:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:51.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:50 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:50 smithi102 ceph-mon[32821]: osdmap e564: 8 total, 8 up, 8 in 2024-04-06T03:46:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/4100886214' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:51.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:50 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]: dispatch 2024-04-06T03:46:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:51 smithi047 ceph-mon[29365]: pgmap v865: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:51 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:51 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:51 smithi047 ceph-mon[29365]: osdmap e565: 8 total, 8 up, 8 in 2024-04-06T03:46:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:51 smithi047 ceph-mon[37680]: pgmap v865: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:51 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:51 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:52.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:51 smithi047 ceph-mon[37680]: osdmap e565: 8 total, 8 up, 8 in 2024-04-06T03:46:52.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:51 smithi102 ceph-mon[32821]: pgmap v865: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:46:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:51 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:51 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-109"}]': finished 2024-04-06T03:46:52.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:51 smithi102 ceph-mon[32821]: osdmap e565: 8 total, 8 up, 8 in 2024-04-06T03:46:52.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:46:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:46:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:52 smithi047 ceph-mon[29365]: osdmap e566: 8 total, 8 up, 8 in 2024-04-06T03:46:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:53.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:52 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:52 smithi047 ceph-mon[37680]: osdmap e566: 8 total, 8 up, 8 in 2024-04-06T03:46:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:52 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:53.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:52 smithi102 ceph-mon[32821]: osdmap e566: 8 total, 8 up, 8 in 2024-04-06T03:46:53.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:53.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:52 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:54.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:46:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:46:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[29365]: pgmap v868: 196 pgs: 196 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-06T03:46:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[29365]: osdmap e567: 8 total, 8 up, 8 in 2024-04-06T03:46:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:54.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[37680]: pgmap v868: 196 pgs: 196 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-06T03:46:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[37680]: osdmap e567: 8 total, 8 up, 8 in 2024-04-06T03:46:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:54.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:53 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:46:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:53 smithi102 ceph-mon[32821]: pgmap v868: 196 pgs: 196 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-06T03:46:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:53 smithi102 ceph-mon[32821]: osdmap e567: 8 total, 8 up, 8 in 2024-04-06T03:46:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:53 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3941506118' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:54.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:53 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]: dispatch 2024-04-06T03:46:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[29365]: osdmap e568: 8 total, 8 up, 8 in 2024-04-06T03:46:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:55.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:55.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[37680]: osdmap e568: 8 total, 8 up, 8 in 2024-04-06T03:46:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:55.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:55.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi047-74676-104"}]': finished 2024-04-06T03:46:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:54 smithi102 ceph-mon[32821]: osdmap e568: 8 total, 8 up, 8 in 2024-04-06T03:46:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:55.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-06T03:46:56.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:56 smithi102 ceph-mon[32821]: pgmap v871: 196 pgs: 196 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-06T03:46:56.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:56.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:56 smithi102 ceph-mon[32821]: osdmap e569: 8 total, 8 up, 8 in 2024-04-06T03:46:56.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:56.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:56 smithi047 ceph-mon[29365]: pgmap v871: 196 pgs: 196 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-06T03:46:56.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:56.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:56 smithi047 ceph-mon[29365]: osdmap e569: 8 total, 8 up, 8 in 2024-04-06T03:46:56.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:56.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:56 smithi047 ceph-mon[37680]: pgmap v871: 196 pgs: 196 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-06T03:46:56.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi047-74676-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-06T03:46:56.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:56 smithi047 ceph-mon[37680]: osdmap e569: 8 total, 8 up, 8 in 2024-04-06T03:46:56.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:46:57.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:57 smithi102 ceph-mon[32821]: osdmap e570: 8 total, 8 up, 8 in 2024-04-06T03:46:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:57 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:46:57.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:57 smithi102 ceph-mon[32821]: osdmap e571: 8 total, 8 up, 8 in 2024-04-06T03:46:57.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:57 smithi047 ceph-mon[29365]: osdmap e570: 8 total, 8 up, 8 in 2024-04-06T03:46:57.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:57 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:57.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:46:57.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:57 smithi047 ceph-mon[29365]: osdmap e571: 8 total, 8 up, 8 in 2024-04-06T03:46:57.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:57 smithi047 ceph-mon[37680]: osdmap e570: 8 total, 8 up, 8 in 2024-04-06T03:46:57.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:57 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:46:57.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi047-74676-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:46:57.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:57 smithi047 ceph-mon[37680]: osdmap e571: 8 total, 8 up, 8 in 2024-04-06T03:46:58.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:58 smithi102 ceph-mon[32821]: pgmap v874: 196 pgs: 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:58 smithi102 ceph-mon[32821]: osdmap e572: 8 total, 8 up, 8 in 2024-04-06T03:46:58.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:58 smithi047 ceph-mon[29365]: pgmap v874: 196 pgs: 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:58 smithi047 ceph-mon[29365]: osdmap e572: 8 total, 8 up, 8 in 2024-04-06T03:46:58.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:46:58.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:58 smithi047 ceph-mon[37680]: pgmap v874: 196 pgs: 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:46:58.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:58 smithi047 ceph-mon[37680]: osdmap e572: 8 total, 8 up, 8 in 2024-04-06T03:46:58.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:00.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:59 smithi047 ceph-mon[29365]: pgmap v877: 236 pgs: 40 unknown, 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:00.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:00.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:59 smithi047 ceph-mon[29365]: osdmap e573: 8 total, 8 up, 8 in 2024-04-06T03:47:00.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:46:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:59 smithi047 ceph-mon[37680]: pgmap v877: 236 pgs: 40 unknown, 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:59 smithi047 ceph-mon[37680]: osdmap e573: 8 total, 8 up, 8 in 2024-04-06T03:47:00.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:46:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:00.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:59 smithi102 ceph-mon[32821]: pgmap v877: 236 pgs: 40 unknown, 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:00.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:00.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:59 smithi102 ceph-mon[32821]: osdmap e573: 8 total, 8 up, 8 in 2024-04-06T03:47:00.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:46:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:01.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:01.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:01 smithi102 ceph-mon[32821]: osdmap e574: 8 total, 8 up, 8 in 2024-04-06T03:47:01.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-112"}]: dispatch 2024-04-06T03:47:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:01 smithi047 ceph-mon[29365]: osdmap e574: 8 total, 8 up, 8 in 2024-04-06T03:47:01.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-112"}]: dispatch 2024-04-06T03:47:01.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:01.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:01 smithi047 ceph-mon[37680]: osdmap e574: 8 total, 8 up, 8 in 2024-04-06T03:47:01.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-112"}]: dispatch 2024-04-06T03:47:02.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:02 smithi102 ceph-mon[32821]: pgmap v880: 236 pgs: 40 unknown, 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:02.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-112"}]': finished 2024-04-06T03:47:02.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:02 smithi102 ceph-mon[32821]: osdmap e575: 8 total, 8 up, 8 in 2024-04-06T03:47:02.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:02 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:02.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:02 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:02.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[29365]: pgmap v880: 236 pgs: 40 unknown, 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:02.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-112"}]': finished 2024-04-06T03:47:02.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[29365]: osdmap e575: 8 total, 8 up, 8 in 2024-04-06T03:47:02.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:02.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[37680]: pgmap v880: 236 pgs: 40 unknown, 196 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-112"}]': finished 2024-04-06T03:47:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[37680]: osdmap e575: 8 total, 8 up, 8 in 2024-04-06T03:47:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:02 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:02.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:47:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:47:03.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:03 smithi102 ceph-mon[32821]: osdmap e576: 8 total, 8 up, 8 in 2024-04-06T03:47:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112"}]: dispatch 2024-04-06T03:47:03.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112"}]': finished 2024-04-06T03:47:03.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:03.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-mon[29365]: osdmap e576: 8 total, 8 up, 8 in 2024-04-06T03:47:03.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112"}]: dispatch 2024-04-06T03:47:03.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112"}]': finished 2024-04-06T03:47:03.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:03.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-mon[37680]: osdmap e576: 8 total, 8 up, 8 in 2024-04-06T03:47:03.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112"}]: dispatch 2024-04-06T03:47:03.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-112"}]': finished 2024-04-06T03:47:04.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:47:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:47:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:47:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:04 smithi047 ceph-mon[29365]: pgmap v883: 236 pgs: 236 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:47:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:04 smithi047 ceph-mon[29365]: osdmap e577: 8 total, 8 up, 8 in 2024-04-06T03:47:04.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:04 smithi047 ceph-mon[37680]: pgmap v883: 236 pgs: 236 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:47:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:04 smithi047 ceph-mon[37680]: osdmap e577: 8 total, 8 up, 8 in 2024-04-06T03:47:04.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:04 smithi102 ceph-mon[32821]: pgmap v883: 236 pgs: 236 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T03:47:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:04 smithi102 ceph-mon[32821]: osdmap e577: 8 total, 8 up, 8 in 2024-04-06T03:47:04.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:05.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:05 smithi102 ceph-mon[32821]: osdmap e578: 8 total, 8 up, 8 in 2024-04-06T03:47:05.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:05 smithi047 ceph-mon[29365]: osdmap e578: 8 total, 8 up, 8 in 2024-04-06T03:47:05.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:05 smithi047 ceph-mon[37680]: osdmap e578: 8 total, 8 up, 8 in 2024-04-06T03:47:06.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:06 smithi102 ceph-mon[32821]: pgmap v886: 204 pgs: 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:47:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:06 smithi102 ceph-mon[32821]: osdmap e579: 8 total, 8 up, 8 in 2024-04-06T03:47:06.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:06 smithi047 ceph-mon[29365]: pgmap v886: 204 pgs: 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:47:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:06 smithi047 ceph-mon[29365]: osdmap e579: 8 total, 8 up, 8 in 2024-04-06T03:47:06.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:06 smithi047 ceph-mon[37680]: pgmap v886: 204 pgs: 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:47:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:06 smithi047 ceph-mon[37680]: osdmap e579: 8 total, 8 up, 8 in 2024-04-06T03:47:06.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:07 smithi102 ceph-mon[32821]: osdmap e580: 8 total, 8 up, 8 in 2024-04-06T03:47:07.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:07.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:07.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:07 smithi047 ceph-mon[29365]: osdmap e580: 8 total, 8 up, 8 in 2024-04-06T03:47:07.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:07 smithi047 ceph-mon[37680]: osdmap e580: 8 total, 8 up, 8 in 2024-04-06T03:47:07.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:08.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:08 smithi102 ceph-mon[32821]: pgmap v889: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:47:08.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:08.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:08 smithi102 ceph-mon[32821]: osdmap e581: 8 total, 8 up, 8 in 2024-04-06T03:47:08.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-114"}]: dispatch 2024-04-06T03:47:08.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:08 smithi047 ceph-mon[29365]: pgmap v889: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:47:08.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:08.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:08 smithi047 ceph-mon[29365]: osdmap e581: 8 total, 8 up, 8 in 2024-04-06T03:47:08.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-114"}]: dispatch 2024-04-06T03:47:08.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:08 smithi047 ceph-mon[37680]: pgmap v889: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:47:08.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:08.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:08 smithi047 ceph-mon[37680]: osdmap e581: 8 total, 8 up, 8 in 2024-04-06T03:47:08.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-114"}]: dispatch 2024-04-06T03:47:09.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-114"}]': finished 2024-04-06T03:47:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:09 smithi102 ceph-mon[32821]: osdmap e582: 8 total, 8 up, 8 in 2024-04-06T03:47:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-114", "mode": "writeback"}]: dispatch 2024-04-06T03:47:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:09 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:09.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-114", "mode": "writeback"}]': finished 2024-04-06T03:47:09.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-114"}]': finished 2024-04-06T03:47:09.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[37680]: osdmap e582: 8 total, 8 up, 8 in 2024-04-06T03:47:09.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-114", "mode": "writeback"}]: dispatch 2024-04-06T03:47:09.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:09.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-114", "mode": "writeback"}]': finished 2024-04-06T03:47:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-114"}]': finished 2024-04-06T03:47:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[29365]: osdmap e582: 8 total, 8 up, 8 in 2024-04-06T03:47:09.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-114", "mode": "writeback"}]: dispatch 2024-04-06T03:47:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:09.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-114", "mode": "writeback"}]': finished 2024-04-06T03:47:10.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:10 smithi102 ceph-mon[32821]: pgmap v892: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:47:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:10 smithi102 ceph-mon[32821]: osdmap e583: 8 total, 8 up, 8 in 2024-04-06T03:47:10.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:10 smithi047 ceph-mon[37680]: pgmap v892: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:47:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:10 smithi047 ceph-mon[37680]: osdmap e583: 8 total, 8 up, 8 in 2024-04-06T03:47:10.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:10.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:10 smithi047 ceph-mon[29365]: pgmap v892: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:47:10.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:10 smithi047 ceph-mon[29365]: osdmap e583: 8 total, 8 up, 8 in 2024-04-06T03:47:10.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:11 smithi102 ceph-mon[32821]: osdmap e584: 8 total, 8 up, 8 in 2024-04-06T03:47:11.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114"}]: dispatch 2024-04-06T03:47:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:11 smithi047 ceph-mon[37680]: osdmap e584: 8 total, 8 up, 8 in 2024-04-06T03:47:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114"}]: dispatch 2024-04-06T03:47:11.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:11.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:11 smithi047 ceph-mon[29365]: osdmap e584: 8 total, 8 up, 8 in 2024-04-06T03:47:11.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114"}]: dispatch 2024-04-06T03:47:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:12 smithi047 ceph-mon[29365]: pgmap v895: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:12 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114"}]': finished 2024-04-06T03:47:12.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:12 smithi047 ceph-mon[29365]: osdmap e585: 8 total, 8 up, 8 in 2024-04-06T03:47:12.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:12 smithi047 ceph-mon[37680]: pgmap v895: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:12.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:12 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:12.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114"}]': finished 2024-04-06T03:47:12.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:12 smithi047 ceph-mon[37680]: osdmap e585: 8 total, 8 up, 8 in 2024-04-06T03:47:12.835 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:47:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:47:12.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:12 smithi102 ceph-mon[32821]: pgmap v895: 236 pgs: 236 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:12.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:12 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:12.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-114"}]': finished 2024-04-06T03:47:12.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:12 smithi102 ceph-mon[32821]: osdmap e585: 8 total, 8 up, 8 in 2024-04-06T03:47:13.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[29365]: osdmap e586: 8 total, 8 up, 8 in 2024-04-06T03:47:13.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:13.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[29365]: pgmap v898: 204 pgs: 204 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:13.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[29365]: osdmap e587: 8 total, 8 up, 8 in 2024-04-06T03:47:13.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:13.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[37680]: osdmap e586: 8 total, 8 up, 8 in 2024-04-06T03:47:13.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:13.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[37680]: pgmap v898: 204 pgs: 204 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:13.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[37680]: osdmap e587: 8 total, 8 up, 8 in 2024-04-06T03:47:13.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:13 smithi102 ceph-mon[32821]: osdmap e586: 8 total, 8 up, 8 in 2024-04-06T03:47:13.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:13.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:13 smithi102 ceph-mon[32821]: pgmap v898: 204 pgs: 204 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:13.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:13 smithi102 ceph-mon[32821]: osdmap e587: 8 total, 8 up, 8 in 2024-04-06T03:47:13.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:14.246 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:47:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:47:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:47:15.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:15.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:15 smithi102 ceph-mon[32821]: osdmap e588: 8 total, 8 up, 8 in 2024-04-06T03:47:15.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:15.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:15 smithi047 ceph-mon[29365]: osdmap e588: 8 total, 8 up, 8 in 2024-04-06T03:47:15.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:15.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:15 smithi047 ceph-mon[37680]: osdmap e588: 8 total, 8 up, 8 in 2024-04-06T03:47:16.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:16 smithi102 ceph-mon[32821]: pgmap v901: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:16.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:16 smithi102 ceph-mon[32821]: osdmap e589: 8 total, 8 up, 8 in 2024-04-06T03:47:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:16.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:16 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:47:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:16 smithi047 ceph-mon[29365]: pgmap v901: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:16 smithi047 ceph-mon[29365]: osdmap e589: 8 total, 8 up, 8 in 2024-04-06T03:47:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:16.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:16 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:47:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:16 smithi047 ceph-mon[37680]: pgmap v901: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:16 smithi047 ceph-mon[37680]: osdmap e589: 8 total, 8 up, 8 in 2024-04-06T03:47:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:16.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:16 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:47:17.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:17 smithi102 ceph-mon[32821]: osdmap e590: 8 total, 8 up, 8 in 2024-04-06T03:47:17.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-116"}]: dispatch 2024-04-06T03:47:17.429 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:17.429 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:17 smithi047 ceph-mon[29365]: osdmap e590: 8 total, 8 up, 8 in 2024-04-06T03:47:17.429 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-116"}]: dispatch 2024-04-06T03:47:17.430 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:17.430 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:17 smithi047 ceph-mon[37680]: osdmap e590: 8 total, 8 up, 8 in 2024-04-06T03:47:17.430 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-116"}]: dispatch 2024-04-06T03:47:18.174 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[29365]: pgmap v904: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:47:18.175 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-116"}]': finished 2024-04-06T03:47:18.175 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[29365]: osdmap e591: 8 total, 8 up, 8 in 2024-04-06T03:47:18.175 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-116", "mode": "writeback"}]: dispatch 2024-04-06T03:47:18.175 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:18.175 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-116", "mode": "writeback"}]': finished 2024-04-06T03:47:18.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[37680]: pgmap v904: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:47:18.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-116"}]': finished 2024-04-06T03:47:18.175 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[37680]: osdmap e591: 8 total, 8 up, 8 in 2024-04-06T03:47:18.176 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-116", "mode": "writeback"}]: dispatch 2024-04-06T03:47:18.176 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:18.176 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-116", "mode": "writeback"}]': finished 2024-04-06T03:47:18.466 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:18 smithi102 ceph-mon[32821]: pgmap v904: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:47:18.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-116"}]': finished 2024-04-06T03:47:18.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:18 smithi102 ceph-mon[32821]: osdmap e591: 8 total, 8 up, 8 in 2024-04-06T03:47:18.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-116", "mode": "writeback"}]: dispatch 2024-04-06T03:47:18.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:18 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:18.467 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-116", "mode": "writeback"}]': finished 2024-04-06T03:47:19.366 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:19 smithi102 ceph-mon[32821]: osdmap e592: 8 total, 8 up, 8 in 2024-04-06T03:47:19.367 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.4"}]: dispatch 2024-04-06T03:47:19.367 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:19 smithi102 ceph-mon[32821]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.4"}]: dispatch 2024-04-06T03:47:19.367 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.367 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.367 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.367 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[29365]: osdmap e592: 8 total, 8 up, 8 in 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.4"}]: dispatch 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[29365]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.4"}]: dispatch 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[37680]: osdmap e592: 8 total, 8 up, 8 in 2024-04-06T03:47:19.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.4"}]: dispatch 2024-04-06T03:47:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[37680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.4"}]: dispatch 2024-04-06T03:47:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:19.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[29365]: pgmap v907: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:47:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[29365]: 326.4 scrub starts 2024-04-06T03:47:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[29365]: 326.4 scrub ok 2024-04-06T03:47:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:20.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[37680]: pgmap v907: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:47:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[37680]: 326.4 scrub starts 2024-04-06T03:47:20.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[37680]: 326.4 scrub ok 2024-04-06T03:47:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:20.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:20.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:20 smithi102 ceph-mon[32821]: pgmap v907: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:47:20.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:20 smithi102 ceph-mon[32821]: 326.4 scrub starts 2024-04-06T03:47:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:20 smithi102 ceph-mon[32821]: 326.4 scrub ok 2024-04-06T03:47:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:20.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:21.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:47:21.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:47:21.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:21.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:47:21.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:47:21.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:21.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:47:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:47:21.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:22.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:22 smithi047 ceph-mon[29365]: pgmap v908: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 930 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-04-06T03:47:22.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:22 smithi047 ceph-mon[37680]: pgmap v908: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 930 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-04-06T03:47:22.584 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:47:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:47:22.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:22 smithi102 ceph-mon[32821]: pgmap v908: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 930 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-04-06T03:47:24.187 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:47:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:47:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:47:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:24.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:24 smithi047 ceph-mon[29365]: pgmap v909: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-06T03:47:24.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:24.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:24 smithi047 ceph-mon[37680]: pgmap v909: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-06T03:47:24.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:24.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:24 smithi102 ceph-mon[32821]: pgmap v909: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-04-06T03:47:26.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:26 smithi047 ceph-mon[29365]: pgmap v910: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-04-06T03:47:26.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:26 smithi047 ceph-mon[37680]: pgmap v910: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-04-06T03:47:26.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:26 smithi102 ceph-mon[32821]: pgmap v910: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-04-06T03:47:28.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:28 smithi047 ceph-mon[29365]: pgmap v911: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:47:28.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:28 smithi047 ceph-mon[37680]: pgmap v911: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:47:28.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:28 smithi102 ceph-mon[32821]: pgmap v911: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:47:30.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:30 smithi047 ceph-mon[29365]: pgmap v912: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:47:30.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:30 smithi047 ceph-mon[37680]: pgmap v912: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:47:30.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:30 smithi102 ceph-mon[32821]: pgmap v912: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:47:32.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:32 smithi047 ceph-mon[29365]: pgmap v913: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T03:47:32.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:32 smithi047 ceph-mon[37680]: pgmap v913: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T03:47:32.584 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:47:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:47:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:32 smithi102 ceph-mon[32821]: pgmap v913: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T03:47:34.216 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:47:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:47:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:47:34.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:34.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[29365]: pgmap v914: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:47:34.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[29365]: osdmap e593: 8 total, 8 up, 8 in 2024-04-06T03:47:34.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:34.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:34.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:34.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[37680]: pgmap v914: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:47:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[37680]: osdmap e593: 8 total, 8 up, 8 in 2024-04-06T03:47:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:34.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:34.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:34 smithi102 ceph-mon[32821]: pgmap v914: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:47:34.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:34 smithi102 ceph-mon[32821]: osdmap e593: 8 total, 8 up, 8 in 2024-04-06T03:47:34.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:34.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[29365]: osdmap e594: 8 total, 8 up, 8 in 2024-04-06T03:47:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116"}]: dispatch 2024-04-06T03:47:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116"}]': finished 2024-04-06T03:47:35.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:35.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[37680]: osdmap e594: 8 total, 8 up, 8 in 2024-04-06T03:47:35.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116"}]: dispatch 2024-04-06T03:47:35.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:35.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116"}]': finished 2024-04-06T03:47:35.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:35 smithi102 ceph-mon[32821]: osdmap e594: 8 total, 8 up, 8 in 2024-04-06T03:47:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116"}]: dispatch 2024-04-06T03:47:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:35 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:35.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-116"}]': finished 2024-04-06T03:47:36.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:36 smithi047 ceph-mon[29365]: pgmap v917: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:47:36.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:36 smithi047 ceph-mon[29365]: osdmap e595: 8 total, 8 up, 8 in 2024-04-06T03:47:36.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:36 smithi047 ceph-mon[37680]: pgmap v917: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:47:36.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:36 smithi047 ceph-mon[37680]: osdmap e595: 8 total, 8 up, 8 in 2024-04-06T03:47:36.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:36 smithi102 ceph-mon[32821]: pgmap v917: 236 pgs: 236 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:47:36.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:36 smithi102 ceph-mon[32821]: osdmap e595: 8 total, 8 up, 8 in 2024-04-06T03:47:37.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:37 smithi047 ceph-mon[29365]: osdmap e596: 8 total, 8 up, 8 in 2024-04-06T03:47:37.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:37 smithi047 ceph-mon[37680]: osdmap e596: 8 total, 8 up, 8 in 2024-04-06T03:47:37.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:37 smithi102 ceph-mon[32821]: osdmap e596: 8 total, 8 up, 8 in 2024-04-06T03:47:38.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:38 smithi102 ceph-mon[32821]: pgmap v920: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-06T03:47:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:38 smithi102 ceph-mon[32821]: osdmap e597: 8 total, 8 up, 8 in 2024-04-06T03:47:38.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:38.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:38 smithi047 ceph-mon[37680]: pgmap v920: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-06T03:47:38.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:38 smithi047 ceph-mon[37680]: osdmap e597: 8 total, 8 up, 8 in 2024-04-06T03:47:38.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:38.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:38 smithi047 ceph-mon[29365]: pgmap v920: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-06T03:47:38.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:38 smithi047 ceph-mon[29365]: osdmap e597: 8 total, 8 up, 8 in 2024-04-06T03:47:38.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:39.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:39.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:39 smithi102 ceph-mon[32821]: osdmap e598: 8 total, 8 up, 8 in 2024-04-06T03:47:39.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:39 smithi102 ceph-mon[32821]: pgmap v923: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-06T03:47:39.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:39.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:39 smithi047 ceph-mon[37680]: osdmap e598: 8 total, 8 up, 8 in 2024-04-06T03:47:39.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:39 smithi047 ceph-mon[37680]: pgmap v923: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-06T03:47:39.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:39.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:39 smithi047 ceph-mon[29365]: osdmap e598: 8 total, 8 up, 8 in 2024-04-06T03:47:39.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:39 smithi047 ceph-mon[29365]: pgmap v923: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-06T03:47:40.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:40 smithi102 ceph-mon[32821]: osdmap e599: 8 total, 8 up, 8 in 2024-04-06T03:47:40.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:40.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:40 smithi047 ceph-mon[37680]: osdmap e599: 8 total, 8 up, 8 in 2024-04-06T03:47:40.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:40.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:40 smithi047 ceph-mon[29365]: osdmap e599: 8 total, 8 up, 8 in 2024-04-06T03:47:40.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:41.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:41 smithi102 ceph-mon[32821]: osdmap e600: 8 total, 8 up, 8 in 2024-04-06T03:47:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-118"}]: dispatch 2024-04-06T03:47:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:41 smithi102 ceph-mon[32821]: pgmap v926: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-118"}]': finished 2024-04-06T03:47:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:41 smithi102 ceph-mon[32821]: osdmap e601: 8 total, 8 up, 8 in 2024-04-06T03:47:41.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-118", "mode": "writeback"}]: dispatch 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[29365]: osdmap e600: 8 total, 8 up, 8 in 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-118"}]: dispatch 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[29365]: pgmap v926: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-118"}]': finished 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[29365]: osdmap e601: 8 total, 8 up, 8 in 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-118", "mode": "writeback"}]: dispatch 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[37680]: osdmap e600: 8 total, 8 up, 8 in 2024-04-06T03:47:41.744 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-118"}]: dispatch 2024-04-06T03:47:41.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[37680]: pgmap v926: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:41.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-118"}]': finished 2024-04-06T03:47:41.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[37680]: osdmap e601: 8 total, 8 up, 8 in 2024-04-06T03:47:41.745 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-118", "mode": "writeback"}]: dispatch 2024-04-06T03:47:42.390 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:42 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:42.390 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-118", "mode": "writeback"}]': finished 2024-04-06T03:47:42.390 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:42 smithi102 ceph-mon[32821]: osdmap e602: 8 total, 8 up, 8 in 2024-04-06T03:47:42.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:42 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:42.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-118", "mode": "writeback"}]': finished 2024-04-06T03:47:42.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:42 smithi047 ceph-mon[29365]: osdmap e602: 8 total, 8 up, 8 in 2024-04-06T03:47:42.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:42 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:42.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-118", "mode": "writeback"}]': finished 2024-04-06T03:47:42.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:42 smithi047 ceph-mon[37680]: osdmap e602: 8 total, 8 up, 8 in 2024-04-06T03:47:42.652 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:47:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:47:43.773 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:43.773 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-mon[29365]: osdmap e603: 8 total, 8 up, 8 in 2024-04-06T03:47:43.773 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:43.773 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-mon[29365]: pgmap v930: 236 pgs: 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-06T03:47:43.774 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:43.774 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-mon[37680]: osdmap e603: 8 total, 8 up, 8 in 2024-04-06T03:47:43.774 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:43.774 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-mon[37680]: pgmap v930: 236 pgs: 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-06T03:47:43.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:43.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:43 smithi102 ceph-mon[32821]: osdmap e603: 8 total, 8 up, 8 in 2024-04-06T03:47:43.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:43.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:43 smithi102 ceph-mon[32821]: pgmap v930: 236 pgs: 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-06T03:47:44.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:47:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:47:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:47:44.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:44 smithi102 ceph-mon[32821]: osdmap e604: 8 total, 8 up, 8 in 2024-04-06T03:47:44.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118"}]: dispatch 2024-04-06T03:47:44.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:44 smithi047 ceph-mon[29365]: osdmap e604: 8 total, 8 up, 8 in 2024-04-06T03:47:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118"}]: dispatch 2024-04-06T03:47:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:44 smithi047 ceph-mon[37680]: osdmap e604: 8 total, 8 up, 8 in 2024-04-06T03:47:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118"}]: dispatch 2024-04-06T03:47:45.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:45 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118"}]': finished 2024-04-06T03:47:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:45 smithi102 ceph-mon[32821]: osdmap e605: 8 total, 8 up, 8 in 2024-04-06T03:47:45.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:45 smithi102 ceph-mon[32821]: pgmap v933: 236 pgs: 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-06T03:47:45.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:45 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:45.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118"}]': finished 2024-04-06T03:47:45.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:45 smithi047 ceph-mon[37680]: osdmap e605: 8 total, 8 up, 8 in 2024-04-06T03:47:45.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:45 smithi047 ceph-mon[37680]: pgmap v933: 236 pgs: 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-06T03:47:45.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:45 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:45.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-118"}]': finished 2024-04-06T03:47:45.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:45 smithi047 ceph-mon[29365]: osdmap e605: 8 total, 8 up, 8 in 2024-04-06T03:47:45.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:45 smithi047 ceph-mon[29365]: pgmap v933: 236 pgs: 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-06T03:47:46.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:46 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:46.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:46 smithi102 ceph-mon[32821]: osdmap e606: 8 total, 8 up, 8 in 2024-04-06T03:47:46.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:46 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:46.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:46 smithi047 ceph-mon[29365]: osdmap e606: 8 total, 8 up, 8 in 2024-04-06T03:47:46.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:46 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:46.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:46 smithi047 ceph-mon[37680]: osdmap e606: 8 total, 8 up, 8 in 2024-04-06T03:47:47.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:47 smithi102 ceph-mon[32821]: osdmap e607: 8 total, 8 up, 8 in 2024-04-06T03:47:47.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:47.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:47 smithi102 ceph-mon[32821]: pgmap v936: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:47.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:47 smithi047 ceph-mon[37680]: osdmap e607: 8 total, 8 up, 8 in 2024-04-06T03:47:47.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:47.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:47 smithi047 ceph-mon[37680]: pgmap v936: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:47 smithi047 ceph-mon[29365]: osdmap e607: 8 total, 8 up, 8 in 2024-04-06T03:47:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:47 smithi047 ceph-mon[29365]: pgmap v936: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:48.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:48 smithi102 ceph-mon[32821]: osdmap e608: 8 total, 8 up, 8 in 2024-04-06T03:47:48.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:48.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:48 smithi047 ceph-mon[29365]: osdmap e608: 8 total, 8 up, 8 in 2024-04-06T03:47:48.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:48.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:48.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:48 smithi047 ceph-mon[37680]: osdmap e608: 8 total, 8 up, 8 in 2024-04-06T03:47:48.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:49.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:49.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:49 smithi102 ceph-mon[32821]: osdmap e609: 8 total, 8 up, 8 in 2024-04-06T03:47:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-120"}]: dispatch 2024-04-06T03:47:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:49 smithi102 ceph-mon[32821]: pgmap v939: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-120"}]': finished 2024-04-06T03:47:49.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:49 smithi102 ceph-mon[32821]: osdmap e610: 8 total, 8 up, 8 in 2024-04-06T03:47:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[37680]: osdmap e609: 8 total, 8 up, 8 in 2024-04-06T03:47:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-120"}]: dispatch 2024-04-06T03:47:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[37680]: pgmap v939: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-120"}]': finished 2024-04-06T03:47:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[37680]: osdmap e610: 8 total, 8 up, 8 in 2024-04-06T03:47:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[29365]: osdmap e609: 8 total, 8 up, 8 in 2024-04-06T03:47:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-120"}]: dispatch 2024-04-06T03:47:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[29365]: pgmap v939: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:47:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:47:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:47:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-120"}]': finished 2024-04-06T03:47:49.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:49 smithi047 ceph-mon[29365]: osdmap e610: 8 total, 8 up, 8 in 2024-04-06T03:47:50.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-120", "mode": "writeback"}]: dispatch 2024-04-06T03:47:50.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:50 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:50.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-120", "mode": "writeback"}]': finished 2024-04-06T03:47:50.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:50 smithi102 ceph-mon[32821]: osdmap e611: 8 total, 8 up, 8 in 2024-04-06T03:47:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-120", "mode": "writeback"}]: dispatch 2024-04-06T03:47:50.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:50 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:50.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-120", "mode": "writeback"}]': finished 2024-04-06T03:47:50.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:50 smithi047 ceph-mon[29365]: osdmap e611: 8 total, 8 up, 8 in 2024-04-06T03:47:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-120", "mode": "writeback"}]: dispatch 2024-04-06T03:47:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:50 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-120", "mode": "writeback"}]': finished 2024-04-06T03:47:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:50 smithi047 ceph-mon[37680]: osdmap e611: 8 total, 8 up, 8 in 2024-04-06T03:47:51.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:51 smithi102 ceph-mon[32821]: pgmap v942: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:51.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:51.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:51 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:51.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:51.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:51 smithi102 ceph-mon[32821]: osdmap e612: 8 total, 8 up, 8 in 2024-04-06T03:47:51.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120"}]: dispatch 2024-04-06T03:47:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[37680]: pgmap v942: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[37680]: osdmap e612: 8 total, 8 up, 8 in 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120"}]: dispatch 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[29365]: pgmap v942: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:47:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[29365]: osdmap e612: 8 total, 8 up, 8 in 2024-04-06T03:47:51.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120"}]: dispatch 2024-04-06T03:47:52.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:47:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:47:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:52 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120"}]': finished 2024-04-06T03:47:52.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:52 smithi102 ceph-mon[32821]: osdmap e613: 8 total, 8 up, 8 in 2024-04-06T03:47:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:52 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:52.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120"}]': finished 2024-04-06T03:47:52.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:52 smithi047 ceph-mon[29365]: osdmap e613: 8 total, 8 up, 8 in 2024-04-06T03:47:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:52 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:47:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-120"}]': finished 2024-04-06T03:47:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:52 smithi047 ceph-mon[37680]: osdmap e613: 8 total, 8 up, 8 in 2024-04-06T03:47:53.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:53.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:53 smithi102 ceph-mon[32821]: pgmap v945: 236 pgs: 236 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-06T03:47:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:53.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:53 smithi047 ceph-mon[29365]: pgmap v945: 236 pgs: 236 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-06T03:47:53.994 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:47:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:47:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:47:53.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:47:53.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:53 smithi047 ceph-mon[37680]: pgmap v945: 236 pgs: 236 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-06T03:47:54.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:54 smithi102 ceph-mon[32821]: osdmap e614: 8 total, 8 up, 8 in 2024-04-06T03:47:54.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:54 smithi047 ceph-mon[29365]: osdmap e614: 8 total, 8 up, 8 in 2024-04-06T03:47:54.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:54 smithi047 ceph-mon[37680]: osdmap e614: 8 total, 8 up, 8 in 2024-04-06T03:47:55.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:55 smithi102 ceph-mon[32821]: osdmap e615: 8 total, 8 up, 8 in 2024-04-06T03:47:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:55.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:55 smithi102 ceph-mon[32821]: pgmap v948: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:47:55.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:55 smithi047 ceph-mon[29365]: osdmap e615: 8 total, 8 up, 8 in 2024-04-06T03:47:55.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:55.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:55 smithi047 ceph-mon[29365]: pgmap v948: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:47:55.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:55 smithi047 ceph-mon[37680]: osdmap e615: 8 total, 8 up, 8 in 2024-04-06T03:47:55.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:47:55.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:55 smithi047 ceph-mon[37680]: pgmap v948: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:47:56.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:56.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:56 smithi102 ceph-mon[32821]: osdmap e616: 8 total, 8 up, 8 in 2024-04-06T03:47:56.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:56.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:56 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:56.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:56 smithi047 ceph-mon[29365]: osdmap e616: 8 total, 8 up, 8 in 2024-04-06T03:47:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:56 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:47:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:56 smithi047 ceph-mon[37680]: osdmap e616: 8 total, 8 up, 8 in 2024-04-06T03:47:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:47:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:56 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:47:57.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:57.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:57 smithi102 ceph-mon[32821]: osdmap e617: 8 total, 8 up, 8 in 2024-04-06T03:47:57.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-122"}]: dispatch 2024-04-06T03:47:57.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:57 smithi102 ceph-mon[32821]: pgmap v951: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:47:57.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:57.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:57 smithi047 ceph-mon[37680]: osdmap e617: 8 total, 8 up, 8 in 2024-04-06T03:47:57.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-122"}]: dispatch 2024-04-06T03:47:57.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:57 smithi047 ceph-mon[37680]: pgmap v951: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:47:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:47:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:57 smithi047 ceph-mon[29365]: osdmap e617: 8 total, 8 up, 8 in 2024-04-06T03:47:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-122"}]: dispatch 2024-04-06T03:47:57.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:57 smithi047 ceph-mon[29365]: pgmap v951: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:47:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-122"}]': finished 2024-04-06T03:47:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:58 smithi047 ceph-mon[29365]: osdmap e618: 8 total, 8 up, 8 in 2024-04-06T03:47:58.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-122", "mode": "writeback"}]: dispatch 2024-04-06T03:47:58.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-122"}]': finished 2024-04-06T03:47:58.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:58 smithi047 ceph-mon[37680]: osdmap e618: 8 total, 8 up, 8 in 2024-04-06T03:47:58.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-122", "mode": "writeback"}]: dispatch 2024-04-06T03:47:59.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-122"}]': finished 2024-04-06T03:47:59.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:58 smithi102 ceph-mon[32821]: osdmap e618: 8 total, 8 up, 8 in 2024-04-06T03:47:59.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-122", "mode": "writeback"}]: dispatch 2024-04-06T03:47:59.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-122", "mode": "writeback"}]': finished 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[29365]: osdmap e619: 8 total, 8 up, 8 in 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[29365]: pgmap v954: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-122", "mode": "writeback"}]': finished 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[37680]: osdmap e619: 8 total, 8 up, 8 in 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[37680]: pgmap v954: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:47:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:47:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:59 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-122", "mode": "writeback"}]': finished 2024-04-06T03:48:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:59 smithi102 ceph-mon[32821]: osdmap e619: 8 total, 8 up, 8 in 2024-04-06T03:48:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:59 smithi102 ceph-mon[32821]: pgmap v954: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:00.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:47:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:00.895 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:00.895 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:00 smithi047 ceph-mon[37680]: osdmap e620: 8 total, 8 up, 8 in 2024-04-06T03:48:00.895 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122"}]: dispatch 2024-04-06T03:48:00.895 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:00.895 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:00 smithi047 ceph-mon[29365]: osdmap e620: 8 total, 8 up, 8 in 2024-04-06T03:48:00.895 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122"}]: dispatch 2024-04-06T03:48:00.985 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:00.986 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:00 smithi102 ceph-mon[32821]: osdmap e620: 8 total, 8 up, 8 in 2024-04-06T03:48:00.986 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122"}]: dispatch 2024-04-06T03:48:01.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122"}]': finished 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[29365]: pgmap v956: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[29365]: osdmap e621: 8 total, 8 up, 8 in 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122"}]': finished 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[37680]: pgmap v956: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[37680]: osdmap e621: 8 total, 8 up, 8 in 2024-04-06T03:48:01.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:01 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:01 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-122"}]': finished 2024-04-06T03:48:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:01 smithi102 ceph-mon[32821]: pgmap v956: 236 pgs: 236 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:01 smithi102 ceph-mon[32821]: osdmap e621: 8 total, 8 up, 8 in 2024-04-06T03:48:02.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:01 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:02.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:48:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:48:02.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:02 smithi102 ceph-mon[32821]: osdmap e622: 8 total, 8 up, 8 in 2024-04-06T03:48:02.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:02 smithi047 ceph-mon[37680]: osdmap e622: 8 total, 8 up, 8 in 2024-04-06T03:48:02.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:02 smithi047 ceph-mon[29365]: osdmap e622: 8 total, 8 up, 8 in 2024-04-06T03:48:03.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:48:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:48:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-mon[37680]: pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-mon[37680]: osdmap e623: 8 total, 8 up, 8 in 2024-04-06T03:48:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:03.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:03.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-mon[29365]: pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:03.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-mon[29365]: osdmap e623: 8 total, 8 up, 8 in 2024-04-06T03:48:03.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:04.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:04.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:03 smithi102 ceph-mon[32821]: pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:03 smithi102 ceph-mon[32821]: osdmap e623: 8 total, 8 up, 8 in 2024-04-06T03:48:04.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:04.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:04.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:04 smithi047 ceph-mon[29365]: osdmap e624: 8 total, 8 up, 8 in 2024-04-06T03:48:04.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:04.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:04.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:04 smithi047 ceph-mon[37680]: osdmap e624: 8 total, 8 up, 8 in 2024-04-06T03:48:04.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:05.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:05.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:04 smithi102 ceph-mon[32821]: osdmap e624: 8 total, 8 up, 8 in 2024-04-06T03:48:05.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:05.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:05 smithi047 ceph-mon[29365]: pgmap v962: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:05.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:05 smithi047 ceph-mon[29365]: osdmap e625: 8 total, 8 up, 8 in 2024-04-06T03:48:05.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:05 smithi047 ceph-mon[37680]: pgmap v962: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:05 smithi047 ceph-mon[37680]: osdmap e625: 8 total, 8 up, 8 in 2024-04-06T03:48:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:06.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:05 smithi102 ceph-mon[32821]: pgmap v962: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:06.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:05 smithi102 ceph-mon[32821]: osdmap e625: 8 total, 8 up, 8 in 2024-04-06T03:48:06.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[29365]: osdmap e626: 8 total, 8 up, 8 in 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-124"}]: dispatch 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-124"}]': finished 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[29365]: osdmap e627: 8 total, 8 up, 8 in 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[37680]: osdmap e626: 8 total, 8 up, 8 in 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-124"}]: dispatch 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-124"}]': finished 2024-04-06T03:48:06.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:06 smithi047 ceph-mon[37680]: osdmap e627: 8 total, 8 up, 8 in 2024-04-06T03:48:07.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:07.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:06 smithi102 ceph-mon[32821]: osdmap e626: 8 total, 8 up, 8 in 2024-04-06T03:48:07.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-124"}]: dispatch 2024-04-06T03:48:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-124"}]': finished 2024-04-06T03:48:07.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:06 smithi102 ceph-mon[32821]: osdmap e627: 8 total, 8 up, 8 in 2024-04-06T03:48:07.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[29365]: pgmap v965: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-124", "mode": "writeback"}]: dispatch 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-124", "mode": "writeback"}]': finished 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[29365]: osdmap e628: 8 total, 8 up, 8 in 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[37680]: pgmap v965: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-124", "mode": "writeback"}]: dispatch 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-124", "mode": "writeback"}]': finished 2024-04-06T03:48:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:07 smithi047 ceph-mon[37680]: osdmap e628: 8 total, 8 up, 8 in 2024-04-06T03:48:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:07 smithi102 ceph-mon[32821]: pgmap v965: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:48:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-124", "mode": "writeback"}]: dispatch 2024-04-06T03:48:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:07 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-124", "mode": "writeback"}]': finished 2024-04-06T03:48:08.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:07 smithi102 ceph-mon[32821]: osdmap e628: 8 total, 8 up, 8 in 2024-04-06T03:48:09.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:09 smithi047 ceph-mon[29365]: pgmap v968: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:48:09.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:09 smithi047 ceph-mon[29365]: osdmap e629: 8 total, 8 up, 8 in 2024-04-06T03:48:09.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:09.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:09 smithi047 ceph-mon[37680]: pgmap v968: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:48:09.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:09 smithi047 ceph-mon[37680]: osdmap e629: 8 total, 8 up, 8 in 2024-04-06T03:48:09.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:09 smithi102 ceph-mon[32821]: pgmap v968: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-06T03:48:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:09 smithi102 ceph-mon[32821]: osdmap e629: 8 total, 8 up, 8 in 2024-04-06T03:48:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[29365]: osdmap e630: 8 total, 8 up, 8 in 2024-04-06T03:48:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124"}]: dispatch 2024-04-06T03:48:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124"}]': finished 2024-04-06T03:48:10.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[29365]: osdmap e631: 8 total, 8 up, 8 in 2024-04-06T03:48:10.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:10.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[37680]: osdmap e630: 8 total, 8 up, 8 in 2024-04-06T03:48:10.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124"}]: dispatch 2024-04-06T03:48:10.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:10.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124"}]': finished 2024-04-06T03:48:10.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:10 smithi047 ceph-mon[37680]: osdmap e631: 8 total, 8 up, 8 in 2024-04-06T03:48:11.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:11.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:10 smithi102 ceph-mon[32821]: osdmap e630: 8 total, 8 up, 8 in 2024-04-06T03:48:11.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124"}]: dispatch 2024-04-06T03:48:11.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:10 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:11.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:10 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-124"}]': finished 2024-04-06T03:48:11.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:10 smithi102 ceph-mon[32821]: osdmap e631: 8 total, 8 up, 8 in 2024-04-06T03:48:12.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:11 smithi047 ceph-mon[29365]: pgmap v971: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:12.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:11 smithi047 ceph-mon[37680]: pgmap v971: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:12.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:11 smithi102 ceph-mon[32821]: pgmap v971: 236 pgs: 236 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:12.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:48:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:48:13.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:12 smithi047 ceph-mon[29365]: osdmap e632: 8 total, 8 up, 8 in 2024-04-06T03:48:13.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:12 smithi047 ceph-mon[29365]: osdmap e633: 8 total, 8 up, 8 in 2024-04-06T03:48:13.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:13.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:12 smithi047 ceph-mon[37680]: osdmap e632: 8 total, 8 up, 8 in 2024-04-06T03:48:13.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:12 smithi047 ceph-mon[37680]: osdmap e633: 8 total, 8 up, 8 in 2024-04-06T03:48:13.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:13.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:12 smithi102 ceph-mon[32821]: osdmap e632: 8 total, 8 up, 8 in 2024-04-06T03:48:13.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:12 smithi102 ceph-mon[32821]: osdmap e633: 8 total, 8 up, 8 in 2024-04-06T03:48:13.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:14.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:48:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[29365]: pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[29365]: osdmap e634: 8 total, 8 up, 8 in 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[37680]: pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[37680]: osdmap e634: 8 total, 8 up, 8 in 2024-04-06T03:48:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:14.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:13 smithi102 ceph-mon[32821]: pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:13 smithi102 ceph-mon[32821]: osdmap e634: 8 total, 8 up, 8 in 2024-04-06T03:48:14.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:15.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:15 smithi047 ceph-mon[37680]: pgmap v977: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:15.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:15.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:15 smithi047 ceph-mon[37680]: osdmap e635: 8 total, 8 up, 8 in 2024-04-06T03:48:15.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-126"}]: dispatch 2024-04-06T03:48:15.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:15 smithi047 ceph-mon[29365]: pgmap v977: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:15.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:15.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:15 smithi047 ceph-mon[29365]: osdmap e635: 8 total, 8 up, 8 in 2024-04-06T03:48:15.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-126"}]: dispatch 2024-04-06T03:48:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:15 smithi102 ceph-mon[32821]: pgmap v977: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:15 smithi102 ceph-mon[32821]: osdmap e635: 8 total, 8 up, 8 in 2024-04-06T03:48:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-126"}]: dispatch 2024-04-06T03:48:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-126"}]': finished 2024-04-06T03:48:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[29365]: osdmap e636: 8 total, 8 up, 8 in 2024-04-06T03:48:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-126", "mode": "writeback"}]: dispatch 2024-04-06T03:48:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-126", "mode": "writeback"}]': finished 2024-04-06T03:48:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[29365]: osdmap e637: 8 total, 8 up, 8 in 2024-04-06T03:48:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:16.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-126"}]': finished 2024-04-06T03:48:16.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[37680]: osdmap e636: 8 total, 8 up, 8 in 2024-04-06T03:48:16.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-126", "mode": "writeback"}]: dispatch 2024-04-06T03:48:16.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:16.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-126", "mode": "writeback"}]': finished 2024-04-06T03:48:16.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[37680]: osdmap e637: 8 total, 8 up, 8 in 2024-04-06T03:48:16.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:17.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-126"}]': finished 2024-04-06T03:48:17.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:16 smithi102 ceph-mon[32821]: osdmap e636: 8 total, 8 up, 8 in 2024-04-06T03:48:17.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-126", "mode": "writeback"}]: dispatch 2024-04-06T03:48:17.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:16 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-126", "mode": "writeback"}]': finished 2024-04-06T03:48:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:16 smithi102 ceph-mon[32821]: osdmap e637: 8 total, 8 up, 8 in 2024-04-06T03:48:17.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:17.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:17 smithi047 ceph-mon[29365]: pgmap v981: 236 pgs: 236 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:17.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:17.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:17 smithi047 ceph-mon[29365]: osdmap e638: 8 total, 8 up, 8 in 2024-04-06T03:48:17.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126"}]: dispatch 2024-04-06T03:48:17.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:17 smithi047 ceph-mon[37680]: pgmap v981: 236 pgs: 236 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:17.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:17.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:17 smithi047 ceph-mon[37680]: osdmap e638: 8 total, 8 up, 8 in 2024-04-06T03:48:17.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126"}]: dispatch 2024-04-06T03:48:18.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:17 smithi102 ceph-mon[32821]: pgmap v981: 236 pgs: 236 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:18.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:18.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:17 smithi102 ceph-mon[32821]: osdmap e638: 8 total, 8 up, 8 in 2024-04-06T03:48:18.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126"}]: dispatch 2024-04-06T03:48:18.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:18 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:18.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126"}]': finished 2024-04-06T03:48:18.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:18 smithi047 ceph-mon[37680]: osdmap e639: 8 total, 8 up, 8 in 2024-04-06T03:48:18.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:18.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:18 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:18.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126"}]': finished 2024-04-06T03:48:18.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:18 smithi047 ceph-mon[29365]: osdmap e639: 8 total, 8 up, 8 in 2024-04-06T03:48:18.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:19.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:18 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:19.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-126"}]': finished 2024-04-06T03:48:19.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:18 smithi102 ceph-mon[32821]: osdmap e639: 8 total, 8 up, 8 in 2024-04-06T03:48:19.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9048 ms) 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6047 ms) 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5042 ms) 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25418 ms) 2024-04-06T03:48:19.525 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14051 ms) 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12057 ms) 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: 00000010 69 73 |is| 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: 00000012 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12052 ms) 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: require_osd_release = squid 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6034 ms) 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (555577 ms total) 2024-04-06T03:48:19.526 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1490 ms) 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10543 ms) 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18076 ms) 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (3 ms) 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30112 ms total) 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7032 ms) 2024-04-06T03:48:19.527 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8052 ms) 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: waiting for scrub... 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: done waiting 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24157 ms) 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9285 ms) 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8038 ms) 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-04-06T03:48:19.528 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8055 ms) 2024-04-06T03:48:19.529 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-06T03:48:19.529 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10057 ms) 2024-04-06T03:48:19.529 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-04-06T03:48:20.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:19 smithi102 ceph-mon[32821]: pgmap v984: 236 pgs: 236 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:20.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:19 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:20.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:19 smithi102 ceph-mon[32821]: osdmap e640: 8 total, 8 up, 8 in 2024-04-06T03:48:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:19 smithi047 ceph-mon[37680]: pgmap v984: 236 pgs: 236 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:19 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:19 smithi047 ceph-mon[37680]: osdmap e640: 8 total, 8 up, 8 in 2024-04-06T03:48:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:19 smithi047 ceph-mon[29365]: pgmap v984: 236 pgs: 236 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:19 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:19 smithi047 ceph-mon[29365]: osdmap e640: 8 total, 8 up, 8 in 2024-04-06T03:48:21.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:48:21.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:20 smithi102 ceph-mon[32821]: osdmap e641: 8 total, 8 up, 8 in 2024-04-06T03:48:21.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:48:21.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:20 smithi047 ceph-mon[37680]: osdmap e641: 8 total, 8 up, 8 in 2024-04-06T03:48:21.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:48:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:20 smithi047 ceph-mon[29365]: osdmap e641: 8 total, 8 up, 8 in 2024-04-06T03:48:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:22.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:21 smithi102 ceph-mon[32821]: pgmap v987: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:22.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:48:22.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:48:22.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:48:22.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:22.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:21 smithi102 ceph-mon[32821]: osdmap e642: 8 total, 8 up, 8 in 2024-04-06T03:48:22.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[37680]: pgmap v987: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[37680]: osdmap e642: 8 total, 8 up, 8 in 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[29365]: pgmap v987: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[29365]: osdmap e642: 8 total, 8 up, 8 in 2024-04-06T03:48:22.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:22.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:48:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:48:23.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:23.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:23.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:23 smithi102 ceph-mon[32821]: osdmap e643: 8 total, 8 up, 8 in 2024-04-06T03:48:23.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-128"}]: dispatch 2024-04-06T03:48:23.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:23 smithi102 ceph-mon[32821]: pgmap v990: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:23.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:48:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:48:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[37680]: osdmap e643: 8 total, 8 up, 8 in 2024-04-06T03:48:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-128"}]: dispatch 2024-04-06T03:48:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[37680]: pgmap v990: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[29365]: osdmap e643: 8 total, 8 up, 8 in 2024-04-06T03:48:23.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-128"}]: dispatch 2024-04-06T03:48:23.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:23 smithi047 ceph-mon[29365]: pgmap v990: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:24.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-128"}]': finished 2024-04-06T03:48:24.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:24 smithi102 ceph-mon[32821]: osdmap e644: 8 total, 8 up, 8 in 2024-04-06T03:48:24.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-128", "mode": "writeback"}]: dispatch 2024-04-06T03:48:24.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-128"}]': finished 2024-04-06T03:48:24.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:24 smithi047 ceph-mon[29365]: osdmap e644: 8 total, 8 up, 8 in 2024-04-06T03:48:24.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-128", "mode": "writeback"}]: dispatch 2024-04-06T03:48:24.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-128"}]': finished 2024-04-06T03:48:24.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:24 smithi047 ceph-mon[37680]: osdmap e644: 8 total, 8 up, 8 in 2024-04-06T03:48:24.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-128", "mode": "writeback"}]: dispatch 2024-04-06T03:48:25.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:25 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:25.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-128", "mode": "writeback"}]': finished 2024-04-06T03:48:25.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:25 smithi102 ceph-mon[32821]: osdmap e645: 8 total, 8 up, 8 in 2024-04-06T03:48:25.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:25 smithi102 ceph-mon[32821]: pgmap v993: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:25.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:25 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:25.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-128", "mode": "writeback"}]': finished 2024-04-06T03:48:25.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:25 smithi047 ceph-mon[29365]: osdmap e645: 8 total, 8 up, 8 in 2024-04-06T03:48:25.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:25 smithi047 ceph-mon[29365]: pgmap v993: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:25.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:25 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:25.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-128", "mode": "writeback"}]': finished 2024-04-06T03:48:25.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:25 smithi047 ceph-mon[37680]: osdmap e645: 8 total, 8 up, 8 in 2024-04-06T03:48:25.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:25 smithi047 ceph-mon[37680]: pgmap v993: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:26.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:26 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:26.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:26 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:26.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:26 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:27.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:27 smithi102 ceph-mon[32821]: pgmap v994: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 403 B/s wr, 1 op/s 2024-04-06T03:48:27.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:27 smithi047 ceph-mon[37680]: pgmap v994: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 403 B/s wr, 1 op/s 2024-04-06T03:48:27.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:27 smithi047 ceph-mon[29365]: pgmap v994: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 403 B/s wr, 1 op/s 2024-04-06T03:48:29.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:29 smithi047 ceph-mon[29365]: pgmap v995: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1011 B/s rd, 337 B/s wr, 1 op/s 2024-04-06T03:48:29.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:29 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:29.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:29 smithi047 ceph-mon[37680]: pgmap v995: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1011 B/s rd, 337 B/s wr, 1 op/s 2024-04-06T03:48:29.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:29 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:30.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:29 smithi102 ceph-mon[32821]: pgmap v995: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1011 B/s rd, 337 B/s wr, 1 op/s 2024-04-06T03:48:30.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:29 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:30.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:30.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:30 smithi047 ceph-mon[29365]: osdmap e646: 8 total, 8 up, 8 in 2024-04-06T03:48:30.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128"}]: dispatch 2024-04-06T03:48:30.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:30.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:30 smithi047 ceph-mon[37680]: osdmap e646: 8 total, 8 up, 8 in 2024-04-06T03:48:30.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128"}]: dispatch 2024-04-06T03:48:31.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:31.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:30 smithi102 ceph-mon[32821]: osdmap e646: 8 total, 8 up, 8 in 2024-04-06T03:48:31.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128"}]: dispatch 2024-04-06T03:48:31.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:31 smithi047 ceph-mon[29365]: pgmap v997: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 869 B/s rd, 289 B/s wr, 1 op/s 2024-04-06T03:48:31.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:31 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:31.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128"}]': finished 2024-04-06T03:48:31.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:31 smithi047 ceph-mon[29365]: osdmap e647: 8 total, 8 up, 8 in 2024-04-06T03:48:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:31 smithi047 ceph-mon[37680]: pgmap v997: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 869 B/s rd, 289 B/s wr, 1 op/s 2024-04-06T03:48:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:31 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128"}]': finished 2024-04-06T03:48:31.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:31 smithi047 ceph-mon[37680]: osdmap e647: 8 total, 8 up, 8 in 2024-04-06T03:48:32.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:31 smithi102 ceph-mon[32821]: pgmap v997: 236 pgs: 236 active+clean; 582 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 869 B/s rd, 289 B/s wr, 1 op/s 2024-04-06T03:48:32.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:31 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:32.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-128"}]': finished 2024-04-06T03:48:32.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:31 smithi102 ceph-mon[32821]: osdmap e647: 8 total, 8 up, 8 in 2024-04-06T03:48:32.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:32 smithi102 ceph-mon[32821]: osdmap e648: 8 total, 8 up, 8 in 2024-04-06T03:48:32.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:48:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:48:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:32 smithi047 ceph-mon[29365]: osdmap e648: 8 total, 8 up, 8 in 2024-04-06T03:48:32.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:32 smithi047 ceph-mon[37680]: osdmap e648: 8 total, 8 up, 8 in 2024-04-06T03:48:33.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:48:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:48:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[29365]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-04-06T03:48:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[29365]: osdmap e649: 8 total, 8 up, 8 in 2024-04-06T03:48:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:33.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:33.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[37680]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-04-06T03:48:33.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[37680]: osdmap e649: 8 total, 8 up, 8 in 2024-04-06T03:48:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:33.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:33 smithi102 ceph-mon[32821]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-04-06T03:48:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:33 smithi102 ceph-mon[32821]: osdmap e649: 8 total, 8 up, 8 in 2024-04-06T03:48:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:33 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[37680]: osdmap e650: 8 total, 8 up, 8 in 2024-04-06T03:48:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[37680]: osdmap e651: 8 total, 8 up, 8 in 2024-04-06T03:48:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[29365]: osdmap e650: 8 total, 8 up, 8 in 2024-04-06T03:48:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:34.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:34 smithi047 ceph-mon[29365]: osdmap e651: 8 total, 8 up, 8 in 2024-04-06T03:48:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:34 smithi102 ceph-mon[32821]: osdmap e650: 8 total, 8 up, 8 in 2024-04-06T03:48:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:35.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:34 smithi102 ceph-mon[32821]: osdmap e651: 8 total, 8 up, 8 in 2024-04-06T03:48:35.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[37680]: pgmap v1003: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:48:35.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-130"}]: dispatch 2024-04-06T03:48:35.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-130"}]': finished 2024-04-06T03:48:35.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[37680]: osdmap e652: 8 total, 8 up, 8 in 2024-04-06T03:48:35.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-130", "mode": "writeback"}]: dispatch 2024-04-06T03:48:35.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[29365]: pgmap v1003: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:48:35.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-130"}]: dispatch 2024-04-06T03:48:35.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-130"}]': finished 2024-04-06T03:48:35.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[29365]: osdmap e652: 8 total, 8 up, 8 in 2024-04-06T03:48:35.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-130", "mode": "writeback"}]: dispatch 2024-04-06T03:48:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:35 smithi102 ceph-mon[32821]: pgmap v1003: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T03:48:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-130"}]: dispatch 2024-04-06T03:48:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-130"}]': finished 2024-04-06T03:48:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:35 smithi102 ceph-mon[32821]: osdmap e652: 8 total, 8 up, 8 in 2024-04-06T03:48:36.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-130", "mode": "writeback"}]: dispatch 2024-04-06T03:48:36.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:36 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:36.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-130", "mode": "writeback"}]': finished 2024-04-06T03:48:36.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:36 smithi047 ceph-mon[37680]: osdmap e653: 8 total, 8 up, 8 in 2024-04-06T03:48:36.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:36 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:36.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-130", "mode": "writeback"}]': finished 2024-04-06T03:48:36.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:36 smithi047 ceph-mon[29365]: osdmap e653: 8 total, 8 up, 8 in 2024-04-06T03:48:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:36 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-130", "mode": "writeback"}]': finished 2024-04-06T03:48:37.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:36 smithi102 ceph-mon[32821]: osdmap e653: 8 total, 8 up, 8 in 2024-04-06T03:48:37.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:37 smithi047 ceph-mon[29365]: pgmap v1006: 236 pgs: 236 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:37.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:37.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:37 smithi047 ceph-mon[37680]: pgmap v1006: 236 pgs: 236 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:37.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:38.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:37 smithi102 ceph-mon[32821]: pgmap v1006: 236 pgs: 236 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:38.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:38.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:38.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:38 smithi047 ceph-mon[29365]: osdmap e654: 8 total, 8 up, 8 in 2024-04-06T03:48:38.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130"}]: dispatch 2024-04-06T03:48:38.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:38.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:38 smithi047 ceph-mon[37680]: osdmap e654: 8 total, 8 up, 8 in 2024-04-06T03:48:38.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130"}]: dispatch 2024-04-06T03:48:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:38 smithi102 ceph-mon[32821]: osdmap e654: 8 total, 8 up, 8 in 2024-04-06T03:48:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130"}]: dispatch 2024-04-06T03:48:40.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:39 smithi047 ceph-mon[37680]: pgmap v1009: 236 pgs: 236 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:40.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:39 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:40.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130"}]': finished 2024-04-06T03:48:40.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:39 smithi047 ceph-mon[37680]: osdmap e655: 8 total, 8 up, 8 in 2024-04-06T03:48:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:39 smithi047 ceph-mon[29365]: pgmap v1009: 236 pgs: 236 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:39 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130"}]': finished 2024-04-06T03:48:40.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:39 smithi047 ceph-mon[29365]: osdmap e655: 8 total, 8 up, 8 in 2024-04-06T03:48:40.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:39 smithi102 ceph-mon[32821]: pgmap v1009: 236 pgs: 236 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:48:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:39 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-130"}]': finished 2024-04-06T03:48:40.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:39 smithi102 ceph-mon[32821]: osdmap e655: 8 total, 8 up, 8 in 2024-04-06T03:48:41.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:40 smithi047 ceph-mon[29365]: osdmap e656: 8 total, 8 up, 8 in 2024-04-06T03:48:41.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:40 smithi047 ceph-mon[29365]: osdmap e657: 8 total, 8 up, 8 in 2024-04-06T03:48:41.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:40 smithi047 ceph-mon[37680]: osdmap e656: 8 total, 8 up, 8 in 2024-04-06T03:48:41.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:40 smithi047 ceph-mon[37680]: osdmap e657: 8 total, 8 up, 8 in 2024-04-06T03:48:41.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:41.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:40 smithi102 ceph-mon[32821]: osdmap e656: 8 total, 8 up, 8 in 2024-04-06T03:48:41.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:40 smithi102 ceph-mon[32821]: osdmap e657: 8 total, 8 up, 8 in 2024-04-06T03:48:41.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:41 smithi047 ceph-mon[29365]: pgmap v1012: 204 pgs: 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:41 smithi047 ceph-mon[29365]: osdmap e658: 8 total, 8 up, 8 in 2024-04-06T03:48:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:41 smithi047 ceph-mon[37680]: pgmap v1012: 204 pgs: 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:41 smithi047 ceph-mon[37680]: osdmap e658: 8 total, 8 up, 8 in 2024-04-06T03:48:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:42.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:41 smithi102 ceph-mon[32821]: pgmap v1012: 204 pgs: 204 active+clean; 582 KiB data, 660 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:42.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:42.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:41 smithi102 ceph-mon[32821]: osdmap e658: 8 total, 8 up, 8 in 2024-04-06T03:48:42.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:42.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:48:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:48:43.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:48:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[37680]: pgmap v1015: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[37680]: osdmap e659: 8 total, 8 up, 8 in 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[29365]: pgmap v1015: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[29365]: osdmap e659: 8 total, 8 up, 8 in 2024-04-06T03:48:43.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:43 smithi102 ceph-mon[32821]: pgmap v1015: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:43 smithi102 ceph-mon[32821]: osdmap e659: 8 total, 8 up, 8 in 2024-04-06T03:48:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:45.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:44 smithi102 ceph-mon[32821]: osdmap e660: 8 total, 8 up, 8 in 2024-04-06T03:48:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-132", "mode": "writeback"}]: dispatch 2024-04-06T03:48:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:44 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-132", "mode": "writeback"}]': finished 2024-04-06T03:48:45.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:44 smithi102 ceph-mon[32821]: osdmap e661: 8 total, 8 up, 8 in 2024-04-06T03:48:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:45.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[29365]: osdmap e660: 8 total, 8 up, 8 in 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-132", "mode": "writeback"}]: dispatch 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-132", "mode": "writeback"}]': finished 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[29365]: osdmap e661: 8 total, 8 up, 8 in 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[37680]: osdmap e660: 8 total, 8 up, 8 in 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-132", "mode": "writeback"}]: dispatch 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-132", "mode": "writeback"}]': finished 2024-04-06T03:48:45.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:44 smithi047 ceph-mon[37680]: osdmap e661: 8 total, 8 up, 8 in 2024-04-06T03:48:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:45 smithi102 ceph-mon[32821]: pgmap v1018: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:45 smithi047 ceph-mon[29365]: pgmap v1018: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:46.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:45 smithi047 ceph-mon[37680]: pgmap v1018: 236 pgs: 32 creating+peering, 204 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:48:47.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:46 smithi102 ceph-mon[32821]: osdmap e662: 8 total, 8 up, 8 in 2024-04-06T03:48:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:46 smithi047 ceph-mon[29365]: osdmap e662: 8 total, 8 up, 8 in 2024-04-06T03:48:47.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:46 smithi047 ceph-mon[37680]: osdmap e662: 8 total, 8 up, 8 in 2024-04-06T03:48:48.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:47 smithi102 ceph-mon[32821]: pgmap v1021: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:48:48.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:47 smithi102 ceph-mon[32821]: osdmap e663: 8 total, 8 up, 8 in 2024-04-06T03:48:48.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:47 smithi047 ceph-mon[29365]: pgmap v1021: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:48:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:47 smithi047 ceph-mon[29365]: osdmap e663: 8 total, 8 up, 8 in 2024-04-06T03:48:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:47 smithi047 ceph-mon[37680]: pgmap v1021: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:48:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:47 smithi047 ceph-mon[37680]: osdmap e663: 8 total, 8 up, 8 in 2024-04-06T03:48:48.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:49.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:49.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:48 smithi102 ceph-mon[32821]: osdmap e664: 8 total, 8 up, 8 in 2024-04-06T03:48:49.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:49.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:48:49.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:49.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:49.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[29365]: osdmap e664: 8 total, 8 up, 8 in 2024-04-06T03:48:49.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:49.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:48:49.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[37680]: osdmap e664: 8 total, 8 up, 8 in 2024-04-06T03:48:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:48:49.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:48:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:49 smithi102 ceph-mon[32821]: pgmap v1024: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:48:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:49 smithi102 ceph-mon[32821]: osdmap e665: 8 total, 8 up, 8 in 2024-04-06T03:48:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:49 smithi047 ceph-mon[29365]: pgmap v1024: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:48:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:49 smithi047 ceph-mon[29365]: osdmap e665: 8 total, 8 up, 8 in 2024-04-06T03:48:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:49 smithi047 ceph-mon[37680]: pgmap v1024: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:48:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:50.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:49 smithi047 ceph-mon[37680]: osdmap e665: 8 total, 8 up, 8 in 2024-04-06T03:48:51.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:50 smithi102 ceph-mon[32821]: osdmap e666: 8 total, 8 up, 8 in 2024-04-06T03:48:51.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:50 smithi047 ceph-mon[29365]: osdmap e666: 8 total, 8 up, 8 in 2024-04-06T03:48:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:50 smithi047 ceph-mon[37680]: osdmap e666: 8 total, 8 up, 8 in 2024-04-06T03:48:51.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:51 smithi102 ceph-mon[32821]: pgmap v1027: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:51 smithi102 ceph-mon[32821]: osdmap e667: 8 total, 8 up, 8 in 2024-04-06T03:48:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:52.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:51 smithi047 ceph-mon[29365]: pgmap v1027: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:52.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:52.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:51 smithi047 ceph-mon[29365]: osdmap e667: 8 total, 8 up, 8 in 2024-04-06T03:48:52.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:51 smithi047 ceph-mon[37680]: pgmap v1027: 236 pgs: 236 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:48:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:51 smithi047 ceph-mon[37680]: osdmap e667: 8 total, 8 up, 8 in 2024-04-06T03:48:52.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132"}]: dispatch 2024-04-06T03:48:52.789 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:48:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:48:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:52 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:53.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:52 smithi102 ceph-mon[32821]: osdmap e668: 8 total, 8 up, 8 in 2024-04-06T03:48:53.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:52 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:53.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:53.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:52 smithi047 ceph-mon[29365]: osdmap e668: 8 total, 8 up, 8 in 2024-04-06T03:48:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:52 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:48:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-132"}]': finished 2024-04-06T03:48:53.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:52 smithi047 ceph-mon[37680]: osdmap e668: 8 total, 8 up, 8 in 2024-04-06T03:48:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:53 smithi102 ceph-mon[32821]: pgmap v1030: 236 pgs: 236 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-04-06T03:48:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:53 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:53 smithi102 ceph-mon[32821]: osdmap e669: 8 total, 8 up, 8 in 2024-04-06T03:48:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:48:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:48:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-mon[29365]: pgmap v1030: 236 pgs: 236 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-04-06T03:48:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:54.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-mon[29365]: osdmap e669: 8 total, 8 up, 8 in 2024-04-06T03:48:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:48:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-mon[37680]: pgmap v1030: 236 pgs: 236 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-04-06T03:48:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:48:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:53 smithi047 ceph-mon[37680]: osdmap e669: 8 total, 8 up, 8 in 2024-04-06T03:48:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:54 smithi102 ceph-mon[32821]: osdmap e670: 8 total, 8 up, 8 in 2024-04-06T03:48:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:55.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:54 smithi047 ceph-mon[37680]: osdmap e670: 8 total, 8 up, 8 in 2024-04-06T03:48:55.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:55.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:54 smithi047 ceph-mon[29365]: osdmap e670: 8 total, 8 up, 8 in 2024-04-06T03:48:55.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:48:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:55 smithi102 ceph-mon[32821]: pgmap v1033: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:48:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:55 smithi102 ceph-mon[32821]: osdmap e671: 8 total, 8 up, 8 in 2024-04-06T03:48:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:56.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:55 smithi047 ceph-mon[29365]: pgmap v1033: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:48:56.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:56.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:55 smithi047 ceph-mon[29365]: osdmap e671: 8 total, 8 up, 8 in 2024-04-06T03:48:56.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:55 smithi047 ceph-mon[37680]: pgmap v1033: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:48:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:48:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:55 smithi047 ceph-mon[37680]: osdmap e671: 8 total, 8 up, 8 in 2024-04-06T03:48:56.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:48:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:56 smithi102 ceph-mon[32821]: osdmap e672: 8 total, 8 up, 8 in 2024-04-06T03:48:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-134"}]: dispatch 2024-04-06T03:48:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-134"}]': finished 2024-04-06T03:48:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:56 smithi102 ceph-mon[32821]: osdmap e673: 8 total, 8 up, 8 in 2024-04-06T03:48:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-134", "mode": "writeback"}]: dispatch 2024-04-06T03:48:57.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[29365]: osdmap e672: 8 total, 8 up, 8 in 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-134"}]: dispatch 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-134"}]': finished 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[29365]: osdmap e673: 8 total, 8 up, 8 in 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-134", "mode": "writeback"}]: dispatch 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[37680]: osdmap e672: 8 total, 8 up, 8 in 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-134"}]: dispatch 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-134"}]': finished 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[37680]: osdmap e673: 8 total, 8 up, 8 in 2024-04-06T03:48:57.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-134", "mode": "writeback"}]: dispatch 2024-04-06T03:48:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:57 smithi102 ceph-mon[32821]: pgmap v1037: 236 pgs: 236 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:57 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-134", "mode": "writeback"}]': finished 2024-04-06T03:48:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:57 smithi102 ceph-mon[32821]: osdmap e674: 8 total, 8 up, 8 in 2024-04-06T03:48:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[29365]: pgmap v1037: 236 pgs: 236 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-134", "mode": "writeback"}]': finished 2024-04-06T03:48:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[29365]: osdmap e674: 8 total, 8 up, 8 in 2024-04-06T03:48:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[37680]: pgmap v1037: 236 pgs: 236 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:48:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-134", "mode": "writeback"}]': finished 2024-04-06T03:48:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[37680]: osdmap e674: 8 total, 8 up, 8 in 2024-04-06T03:48:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:48:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:59 smithi102 ceph-mon[32821]: osdmap e675: 8 total, 8 up, 8 in 2024-04-06T03:48:59.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134"}]: dispatch 2024-04-06T03:48:59.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:48:59 smithi102 ceph-mon[32821]: pgmap v1040: 236 pgs: 236 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:59 smithi047 ceph-mon[37680]: osdmap e675: 8 total, 8 up, 8 in 2024-04-06T03:48:59.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134"}]: dispatch 2024-04-06T03:48:59.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:48:59 smithi047 ceph-mon[37680]: pgmap v1040: 236 pgs: 236 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:48:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:48:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:59 smithi047 ceph-mon[29365]: osdmap e675: 8 total, 8 up, 8 in 2024-04-06T03:48:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134"}]: dispatch 2024-04-06T03:48:59.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:48:59 smithi047 ceph-mon[29365]: pgmap v1040: 236 pgs: 236 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-06T03:49:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:00 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134"}]': finished 2024-04-06T03:49:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:00 smithi102 ceph-mon[32821]: osdmap e676: 8 total, 8 up, 8 in 2024-04-06T03:49:01.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:00 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:01.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134"}]': finished 2024-04-06T03:49:01.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:00 smithi047 ceph-mon[37680]: osdmap e676: 8 total, 8 up, 8 in 2024-04-06T03:49:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:00 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-134"}]': finished 2024-04-06T03:49:01.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:00 smithi047 ceph-mon[29365]: osdmap e676: 8 total, 8 up, 8 in 2024-04-06T03:49:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:01 smithi102 ceph-mon[32821]: osdmap e677: 8 total, 8 up, 8 in 2024-04-06T03:49:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:01 smithi102 ceph-mon[32821]: pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:01 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:01 smithi102 ceph-mon[32821]: osdmap e678: 8 total, 8 up, 8 in 2024-04-06T03:49:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[37680]: osdmap e677: 8 total, 8 up, 8 in 2024-04-06T03:49:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[37680]: pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[37680]: osdmap e678: 8 total, 8 up, 8 in 2024-04-06T03:49:02.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[29365]: osdmap e677: 8 total, 8 up, 8 in 2024-04-06T03:49:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[29365]: pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[29365]: osdmap e678: 8 total, 8 up, 8 in 2024-04-06T03:49:02.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:02.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:49:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:49:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:03.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:03 smithi102 ceph-mon[32821]: osdmap e679: 8 total, 8 up, 8 in 2024-04-06T03:49:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:03.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:03 smithi102 ceph-mon[32821]: pgmap v1046: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:49:03.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:49:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[29365]: osdmap e679: 8 total, 8 up, 8 in 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[29365]: pgmap v1046: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[37680]: osdmap e679: 8 total, 8 up, 8 in 2024-04-06T03:49:03.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:03.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:03 smithi047 ceph-mon[37680]: pgmap v1046: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:49:04.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:04.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:04 smithi102 ceph-mon[32821]: osdmap e680: 8 total, 8 up, 8 in 2024-04-06T03:49:04.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-136"}]: dispatch 2024-04-06T03:49:04.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:04.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[37680]: osdmap e680: 8 total, 8 up, 8 in 2024-04-06T03:49:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-136"}]: dispatch 2024-04-06T03:49:04.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:04.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:04.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:04.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[29365]: osdmap e680: 8 total, 8 up, 8 in 2024-04-06T03:49:04.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-136"}]: dispatch 2024-04-06T03:49:04.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:04.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-136"}]': finished 2024-04-06T03:49:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:05 smithi102 ceph-mon[32821]: osdmap e681: 8 total, 8 up, 8 in 2024-04-06T03:49:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-136", "mode": "writeback"}]: dispatch 2024-04-06T03:49:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:05 smithi102 ceph-mon[32821]: pgmap v1049: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:49:05.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:05 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:05.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-136", "mode": "writeback"}]': finished 2024-04-06T03:49:05.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:05 smithi102 ceph-mon[32821]: osdmap e682: 8 total, 8 up, 8 in 2024-04-06T03:49:05.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-136"}]': finished 2024-04-06T03:49:05.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[29365]: osdmap e681: 8 total, 8 up, 8 in 2024-04-06T03:49:05.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-136", "mode": "writeback"}]: dispatch 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[29365]: pgmap v1049: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-136", "mode": "writeback"}]': finished 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[29365]: osdmap e682: 8 total, 8 up, 8 in 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-136"}]': finished 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[37680]: osdmap e681: 8 total, 8 up, 8 in 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-136", "mode": "writeback"}]: dispatch 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[37680]: pgmap v1049: 236 pgs: 32 unknown, 204 active+clean; 582 KiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-136", "mode": "writeback"}]': finished 2024-04-06T03:49:05.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:05 smithi047 ceph-mon[37680]: osdmap e682: 8 total, 8 up, 8 in 2024-04-06T03:49:06.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:06.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:06.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:07.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:49:07.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:07 smithi102 ceph-mon[32821]: osdmap e683: 8 total, 8 up, 8 in 2024-04-06T03:49:07.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:07 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136"}]: dispatch 2024-04-06T03:49:07.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:07 smithi102 ceph-mon[32821]: pgmap v1052: 236 pgs: 236 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-04-06T03:49:07.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:49:07.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:07 smithi047 ceph-mon[29365]: osdmap e683: 8 total, 8 up, 8 in 2024-04-06T03:49:07.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:07 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136"}]: dispatch 2024-04-06T03:49:07.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:07 smithi047 ceph-mon[29365]: pgmap v1052: 236 pgs: 236 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-04-06T03:49:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:49:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:07 smithi047 ceph-mon[37680]: osdmap e683: 8 total, 8 up, 8 in 2024-04-06T03:49:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:07 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136"}]: dispatch 2024-04-06T03:49:07.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:07 smithi047 ceph-mon[37680]: pgmap v1052: 236 pgs: 236 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-04-06T03:49:09.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:08 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:09.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136"}]': finished 2024-04-06T03:49:09.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:08 smithi102 ceph-mon[32821]: osdmap e684: 8 total, 8 up, 8 in 2024-04-06T03:49:09.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:08 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:09.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136"}]': finished 2024-04-06T03:49:09.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:08 smithi047 ceph-mon[29365]: osdmap e684: 8 total, 8 up, 8 in 2024-04-06T03:49:09.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:08 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:09.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-136"}]': finished 2024-04-06T03:49:09.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:08 smithi047 ceph-mon[37680]: osdmap e684: 8 total, 8 up, 8 in 2024-04-06T03:49:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:09 smithi102 ceph-mon[32821]: osdmap e685: 8 total, 8 up, 8 in 2024-04-06T03:49:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:09 smithi102 ceph-mon[32821]: pgmap v1055: 204 pgs: 204 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:49:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:09 smithi102 ceph-mon[32821]: osdmap e686: 8 total, 8 up, 8 in 2024-04-06T03:49:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:10.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:09 smithi047 ceph-mon[29365]: osdmap e685: 8 total, 8 up, 8 in 2024-04-06T03:49:10.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:09 smithi047 ceph-mon[29365]: pgmap v1055: 204 pgs: 204 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:49:10.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:09 smithi047 ceph-mon[29365]: osdmap e686: 8 total, 8 up, 8 in 2024-04-06T03:49:10.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:09 smithi047 ceph-mon[37680]: osdmap e685: 8 total, 8 up, 8 in 2024-04-06T03:49:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:09 smithi047 ceph-mon[37680]: pgmap v1055: 204 pgs: 204 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-06T03:49:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:09 smithi047 ceph-mon[37680]: osdmap e686: 8 total, 8 up, 8 in 2024-04-06T03:49:10.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:11 smithi102 ceph-mon[32821]: osdmap e687: 8 total, 8 up, 8 in 2024-04-06T03:49:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:11.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:11 smithi102 ceph-mon[32821]: pgmap v1058: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:11 smithi047 ceph-mon[29365]: osdmap e687: 8 total, 8 up, 8 in 2024-04-06T03:49:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:11.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:11 smithi047 ceph-mon[29365]: pgmap v1058: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:11.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:11.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:11 smithi047 ceph-mon[37680]: osdmap e687: 8 total, 8 up, 8 in 2024-04-06T03:49:11.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:11.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:11 smithi047 ceph-mon[37680]: pgmap v1058: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 713 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:12.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:49:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:49:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:12 smithi102 ceph-mon[32821]: osdmap e688: 8 total, 8 up, 8 in 2024-04-06T03:49:12.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:49:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:12 smithi047 ceph-mon[29365]: osdmap e688: 8 total, 8 up, 8 in 2024-04-06T03:49:12.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:49:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:12.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:12 smithi047 ceph-mon[37680]: osdmap e688: 8 total, 8 up, 8 in 2024-04-06T03:49:12.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:49:13.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:49:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:49:13.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:13.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:49:13.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[37680]: osdmap e689: 8 total, 8 up, 8 in 2024-04-06T03:49:13.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:49:13.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[37680]: pgmap v1061: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:13.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:49:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:13.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:49:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[29365]: osdmap e689: 8 total, 8 up, 8 in 2024-04-06T03:49:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:49:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[29365]: pgmap v1061: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:13.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:49:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:49:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:13 smithi102 ceph-mon[32821]: osdmap e689: 8 total, 8 up, 8 in 2024-04-06T03:49:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:49:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:13 smithi102 ceph-mon[32821]: pgmap v1061: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:49:14.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:14 smithi047 ceph-mon[29365]: osdmap e690: 8 total, 8 up, 8 in 2024-04-06T03:49:14.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:49:14.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:49:14.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:14 smithi047 ceph-mon[29365]: osdmap e691: 8 total, 8 up, 8 in 2024-04-06T03:49:14.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:14 smithi047 ceph-mon[37680]: osdmap e690: 8 total, 8 up, 8 in 2024-04-06T03:49:14.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:49:14.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:49:14.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:14 smithi047 ceph-mon[37680]: osdmap e691: 8 total, 8 up, 8 in 2024-04-06T03:49:15.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:14 smithi102 ceph-mon[32821]: osdmap e690: 8 total, 8 up, 8 in 2024-04-06T03:49:15.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-06T03:49:15.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-06T03:49:15.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:14 smithi102 ceph-mon[32821]: osdmap e691: 8 total, 8 up, 8 in 2024-04-06T03:49:15.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:15 smithi047 ceph-mon[29365]: pgmap v1064: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:15.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:15 smithi047 ceph-mon[37680]: pgmap v1064: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:15 smithi102 ceph-mon[32821]: pgmap v1064: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:16.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:16.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138"}]: dispatch 2024-04-06T03:49:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:16.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138"}]: dispatch 2024-04-06T03:49:17.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:17.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138"}]: dispatch 2024-04-06T03:49:18.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138"}]': finished 2024-04-06T03:49:18.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:17 smithi047 ceph-mon[29365]: osdmap e692: 8 total, 8 up, 8 in 2024-04-06T03:49:18.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:17 smithi047 ceph-mon[29365]: pgmap v1066: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138"}]': finished 2024-04-06T03:49:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:17 smithi047 ceph-mon[37680]: osdmap e692: 8 total, 8 up, 8 in 2024-04-06T03:49:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:17 smithi047 ceph-mon[37680]: pgmap v1066: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:18.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-138"}]': finished 2024-04-06T03:49:18.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:17 smithi102 ceph-mon[32821]: osdmap e692: 8 total, 8 up, 8 in 2024-04-06T03:49:18.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:17 smithi102 ceph-mon[32821]: pgmap v1066: 236 pgs: 236 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:19.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:19.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[37680]: osdmap e693: 8 total, 8 up, 8 in 2024-04-06T03:49:19.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[37680]: osdmap e694: 8 total, 8 up, 8 in 2024-04-06T03:49:19.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:19.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[29365]: osdmap e693: 8 total, 8 up, 8 in 2024-04-06T03:49:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[29365]: osdmap e694: 8 total, 8 up, 8 in 2024-04-06T03:49:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:18 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:18 smithi102 ceph-mon[32821]: osdmap e693: 8 total, 8 up, 8 in 2024-04-06T03:49:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:18 smithi102 ceph-mon[32821]: osdmap e694: 8 total, 8 up, 8 in 2024-04-06T03:49:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:19 smithi047 ceph-mon[29365]: pgmap v1069: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:19 smithi047 ceph-mon[29365]: osdmap e695: 8 total, 8 up, 8 in 2024-04-06T03:49:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:19 smithi047 ceph-mon[37680]: pgmap v1069: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:19 smithi047 ceph-mon[37680]: osdmap e695: 8 total, 8 up, 8 in 2024-04-06T03:49:20.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:20.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:19 smithi102 ceph-mon[32821]: pgmap v1069: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:20.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:20.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:19 smithi102 ceph-mon[32821]: osdmap e695: 8 total, 8 up, 8 in 2024-04-06T03:49:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:21.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[37680]: pgmap v1071: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:21.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:21.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[37680]: osdmap e696: 8 total, 8 up, 8 in 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[29365]: pgmap v1071: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[29365]: osdmap e696: 8 total, 8 up, 8 in 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:49:21.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:21.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:21 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:22.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:21 smithi102 ceph-mon[32821]: pgmap v1071: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 722 MiB used, 715 GiB / 715 GiB avail 2024-04-06T03:49:22.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:22.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:21 smithi102 ceph-mon[32821]: osdmap e696: 8 total, 8 up, 8 in 2024-04-06T03:49:22.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:21 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-06T03:49:22.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:49:22.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:22.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:21 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:22.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:49:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:49:22.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_count","val": "3"}]': finished 2024-04-06T03:49:22.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:22 smithi102 ceph-mon[32821]: osdmap e697: 8 total, 8 up, 8 in 2024-04-06T03:49:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:22 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:49:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:22 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:49:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:22 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:49:22.835 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:22 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:22.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_count","val": "3"}]': finished 2024-04-06T03:49:22.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[29365]: osdmap e697: 8 total, 8 up, 8 in 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_count","val": "3"}]': finished 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[37680]: osdmap e697: 8 total, 8 up, 8 in 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:49:22.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:22 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:49:23.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:49:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[29365]: pgmap v1074: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_period","val": "3"}]': finished 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[29365]: osdmap e698: 8 total, 8 up, 8 in 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[37680]: pgmap v1074: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_period","val": "3"}]': finished 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[37680]: osdmap e698: 8 total, 8 up, 8 in 2024-04-06T03:49:23.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:49:23.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:49:24.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:24.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:23 smithi102 ceph-mon[32821]: pgmap v1074: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:24.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_period","val": "3"}]': finished 2024-04-06T03:49:24.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:23 smithi102 ceph-mon[32821]: osdmap e698: 8 total, 8 up, 8 in 2024-04-06T03:49:24.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:49:24.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:49:24.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:24 smithi047 ceph-mon[29365]: osdmap e699: 8 total, 8 up, 8 in 2024-04-06T03:49:24.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:49:24.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-06T03:49:24.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:24 smithi047 ceph-mon[29365]: osdmap e700: 8 total, 8 up, 8 in 2024-04-06T03:49:24.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:24 smithi047 ceph-mon[37680]: osdmap e699: 8 total, 8 up, 8 in 2024-04-06T03:49:24.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:49:24.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-06T03:49:24.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:24 smithi047 ceph-mon[37680]: osdmap e700: 8 total, 8 up, 8 in 2024-04-06T03:49:25.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:24 smithi102 ceph-mon[32821]: osdmap e699: 8 total, 8 up, 8 in 2024-04-06T03:49:25.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-06T03:49:25.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-06T03:49:25.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:24 smithi102 ceph-mon[32821]: osdmap e700: 8 total, 8 up, 8 in 2024-04-06T03:49:25.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:25 smithi047 ceph-mon[37680]: pgmap v1077: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:25.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:25 smithi047 ceph-mon[29365]: pgmap v1077: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:26.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:25 smithi102 ceph-mon[32821]: pgmap v1077: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:26.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:26 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:26.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:26 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:27.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:26 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:27.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:27 smithi047 ceph-mon[29365]: pgmap v1079: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-04-06T03:49:27.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:27 smithi047 ceph-mon[37680]: pgmap v1079: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-04-06T03:49:28.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:27 smithi102 ceph-mon[32821]: pgmap v1079: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-04-06T03:49:29.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:29 smithi047 ceph-mon[29365]: pgmap v1080: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.7 KiB/s wr, 1 op/s 2024-04-06T03:49:29.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:29 smithi047 ceph-mon[37680]: pgmap v1080: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.7 KiB/s wr, 1 op/s 2024-04-06T03:49:30.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:29 smithi102 ceph-mon[32821]: pgmap v1080: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.7 KiB/s wr, 1 op/s 2024-04-06T03:49:31.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:31 smithi047 ceph-mon[29365]: pgmap v1081: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 640 B/s rd, 2 KiB/s wr, 0 op/s 2024-04-06T03:49:31.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:31 smithi047 ceph-mon[37680]: pgmap v1081: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 640 B/s rd, 2 KiB/s wr, 0 op/s 2024-04-06T03:49:32.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:31 smithi102 ceph-mon[32821]: pgmap v1081: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 640 B/s rd, 2 KiB/s wr, 0 op/s 2024-04-06T03:49:32.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:49:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:49:33.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:33.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:33 smithi047 ceph-mon[29365]: pgmap v1082: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 6.4 KiB/s wr, 2 op/s 2024-04-06T03:49:33.994 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:49:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:49:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:49:33.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:33.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:33 smithi047 ceph-mon[37680]: pgmap v1082: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 6.4 KiB/s wr, 2 op/s 2024-04-06T03:49:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:34.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:33 smithi102 ceph-mon[32821]: pgmap v1082: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 6.4 KiB/s wr, 2 op/s 2024-04-06T03:49:34.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:34.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:35.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:35.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:35 smithi047 ceph-mon[29365]: pgmap v1083: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 5.8 KiB/s wr, 1 op/s 2024-04-06T03:49:35.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:35 smithi047 ceph-mon[37680]: pgmap v1083: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 5.8 KiB/s wr, 1 op/s 2024-04-06T03:49:36.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:35 smithi102 ceph-mon[32821]: pgmap v1083: 236 pgs: 236 active+clean; 4.4 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 5.8 KiB/s wr, 1 op/s 2024-04-06T03:49:37.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:37 smithi047 ceph-mon[37680]: pgmap v1084: 236 pgs: 236 active+clean; 4.5 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 8.3 KiB/s wr, 2 op/s 2024-04-06T03:49:37.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:37.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140"}]: dispatch 2024-04-06T03:49:37.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:37 smithi047 ceph-mon[29365]: pgmap v1084: 236 pgs: 236 active+clean; 4.5 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 8.3 KiB/s wr, 2 op/s 2024-04-06T03:49:37.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:37.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140"}]: dispatch 2024-04-06T03:49:38.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:37 smithi102 ceph-mon[32821]: pgmap v1084: 236 pgs: 236 active+clean; 4.5 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 8.3 KiB/s wr, 2 op/s 2024-04-06T03:49:38.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:38.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140"}]: dispatch 2024-04-06T03:49:38.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140"}]': finished 2024-04-06T03:49:38.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:38 smithi047 ceph-mon[29365]: osdmap e701: 8 total, 8 up, 8 in 2024-04-06T03:49:38.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140"}]': finished 2024-04-06T03:49:38.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:38 smithi047 ceph-mon[37680]: osdmap e701: 8 total, 8 up, 8 in 2024-04-06T03:49:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-140"}]': finished 2024-04-06T03:49:39.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:38 smithi102 ceph-mon[32821]: osdmap e701: 8 total, 8 up, 8 in 2024-04-06T03:49:39.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:39 smithi047 ceph-mon[29365]: pgmap v1086: 236 pgs: 236 active+clean; 4.5 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-04-06T03:49:39.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:39 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:39.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:39 smithi047 ceph-mon[29365]: osdmap e702: 8 total, 8 up, 8 in 2024-04-06T03:49:39.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:39 smithi047 ceph-mon[37680]: pgmap v1086: 236 pgs: 236 active+clean; 4.5 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-04-06T03:49:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:39 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:39.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:39 smithi047 ceph-mon[37680]: osdmap e702: 8 total, 8 up, 8 in 2024-04-06T03:49:40.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:39 smithi102 ceph-mon[32821]: pgmap v1086: 236 pgs: 236 active+clean; 4.5 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-04-06T03:49:40.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:39 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:40.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:39 smithi102 ceph-mon[32821]: osdmap e702: 8 total, 8 up, 8 in 2024-04-06T03:49:40.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:40 smithi047 ceph-mon[29365]: osdmap e703: 8 total, 8 up, 8 in 2024-04-06T03:49:40.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:40 smithi047 ceph-mon[37680]: osdmap e703: 8 total, 8 up, 8 in 2024-04-06T03:49:40.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:41.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:40 smithi102 ceph-mon[32821]: osdmap e703: 8 total, 8 up, 8 in 2024-04-06T03:49:41.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:41.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:41 smithi047 ceph-mon[37680]: pgmap v1089: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:49:41.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:41.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:41 smithi047 ceph-mon[37680]: osdmap e704: 8 total, 8 up, 8 in 2024-04-06T03:49:41.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:41 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:41 smithi047 ceph-mon[29365]: pgmap v1089: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:49:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:41 smithi047 ceph-mon[29365]: osdmap e704: 8 total, 8 up, 8 in 2024-04-06T03:49:41.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:41 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:42.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:41 smithi102 ceph-mon[32821]: pgmap v1089: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:49:42.164 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:42.164 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:41 smithi102 ceph-mon[32821]: osdmap e704: 8 total, 8 up, 8 in 2024-04-06T03:49:42.164 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:41 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:42.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:49:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:49:42.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:42.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:42 smithi102 ceph-mon[32821]: osdmap e705: 8 total, 8 up, 8 in 2024-04-06T03:49:42.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:42.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:42.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:42 smithi047 ceph-mon[29365]: osdmap e705: 8 total, 8 up, 8 in 2024-04-06T03:49:42.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:42.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:42.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:42 smithi047 ceph-mon[37680]: osdmap e705: 8 total, 8 up, 8 in 2024-04-06T03:49:42.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:43.993 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:49:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[29365]: pgmap v1092: 236 pgs: 236 active+clean; 4.4 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-142"}]': finished 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[29365]: osdmap e706: 8 total, 8 up, 8 in 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-142", "mode": "writeback"}]: dispatch 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[37680]: pgmap v1092: 236 pgs: 236 active+clean; 4.4 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-142"}]': finished 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[37680]: osdmap e706: 8 total, 8 up, 8 in 2024-04-06T03:49:43.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-142", "mode": "writeback"}]: dispatch 2024-04-06T03:49:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:43 smithi102 ceph-mon[32821]: pgmap v1092: 236 pgs: 236 active+clean; 4.4 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T03:49:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-142"}]': finished 2024-04-06T03:49:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:43 smithi102 ceph-mon[32821]: osdmap e706: 8 total, 8 up, 8 in 2024-04-06T03:49:44.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-142", "mode": "writeback"}]: dispatch 2024-04-06T03:49:44.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:44.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-142", "mode": "writeback"}]': finished 2024-04-06T03:49:44.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[29365]: osdmap e707: 8 total, 8 up, 8 in 2024-04-06T03:49:44.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[29365]: osdmap e708: 8 total, 8 up, 8 in 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-142", "mode": "writeback"}]': finished 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[37680]: osdmap e707: 8 total, 8 up, 8 in 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[37680]: osdmap e708: 8 total, 8 up, 8 in 2024-04-06T03:49:44.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:49:45.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:44 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:45.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-142", "mode": "writeback"}]': finished 2024-04-06T03:49:45.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:44 smithi102 ceph-mon[32821]: osdmap e707: 8 total, 8 up, 8 in 2024-04-06T03:49:45.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:49:45.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:49:45.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:44 smithi102 ceph-mon[32821]: osdmap e708: 8 total, 8 up, 8 in 2024-04-06T03:49:45.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:49:45.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:45 smithi047 ceph-mon[29365]: pgmap v1095: 236 pgs: 236 active+clean; 4.4 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:49:45.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:49:45.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:45 smithi047 ceph-mon[29365]: osdmap e709: 8 total, 8 up, 8 in 2024-04-06T03:49:45.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:49:45.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:45 smithi047 ceph-mon[37680]: pgmap v1095: 236 pgs: 236 active+clean; 4.4 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:49:45.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:49:45.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:45 smithi047 ceph-mon[37680]: osdmap e709: 8 total, 8 up, 8 in 2024-04-06T03:49:45.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:49:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:45 smithi102 ceph-mon[32821]: pgmap v1095: 236 pgs: 236 active+clean; 4.4 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-06T03:49:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:49:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:45 smithi102 ceph-mon[32821]: osdmap e709: 8 total, 8 up, 8 in 2024-04-06T03:49:46.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:49:46.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:46.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:46.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:49:46.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[29365]: osdmap e710: 8 total, 8 up, 8 in 2024-04-06T03:49:46.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:49:46.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:46.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:46.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:49:46.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[37680]: osdmap e710: 8 total, 8 up, 8 in 2024-04-06T03:49:46.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:49:47.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:46 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:47.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:46 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:49:47.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:49:47.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:46 smithi102 ceph-mon[32821]: osdmap e710: 8 total, 8 up, 8 in 2024-04-06T03:49:47.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:49:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:47 smithi047 ceph-mon[29365]: pgmap v1098: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:49:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:47 smithi047 ceph-mon[29365]: osdmap e711: 8 total, 8 up, 8 in 2024-04-06T03:49:47.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:49:47.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:47 smithi047 ceph-mon[37680]: pgmap v1098: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:47.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:49:47.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:47 smithi047 ceph-mon[37680]: osdmap e711: 8 total, 8 up, 8 in 2024-04-06T03:49:47.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:49:48.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:47 smithi102 ceph-mon[32821]: pgmap v1098: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:48.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:49:48.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:47 smithi102 ceph-mon[32821]: osdmap e711: 8 total, 8 up, 8 in 2024-04-06T03:49:48.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-06T03:49:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[29365]: pgmap v1101: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-06T03:49:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[29365]: osdmap e712: 8 total, 8 up, 8 in 2024-04-06T03:49:49.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:49:49.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[37680]: pgmap v1101: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-06T03:49:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[37680]: osdmap e712: 8 total, 8 up, 8 in 2024-04-06T03:49:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:49:49.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:49 smithi102 ceph-mon[32821]: pgmap v1101: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:49:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-06T03:49:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:49 smithi102 ceph-mon[32821]: osdmap e712: 8 total, 8 up, 8 in 2024-04-06T03:49:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-06T03:49:50.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:49:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-06T03:49:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:50 smithi047 ceph-mon[29365]: osdmap e713: 8 total, 8 up, 8 in 2024-04-06T03:49:50.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-06T03:49:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:50 smithi047 ceph-mon[37680]: osdmap e713: 8 total, 8 up, 8 in 2024-04-06T03:49:50.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:51.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-06T03:49:51.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:50 smithi102 ceph-mon[32821]: osdmap e713: 8 total, 8 up, 8 in 2024-04-06T03:49:51.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:51 smithi047 ceph-mon[37680]: pgmap v1104: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:49:51.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:49:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:51 smithi047 ceph-mon[37680]: osdmap e714: 8 total, 8 up, 8 in 2024-04-06T03:49:51.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:51 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:51 smithi047 ceph-mon[29365]: pgmap v1104: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:49:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:49:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:51 smithi047 ceph-mon[29365]: osdmap e714: 8 total, 8 up, 8 in 2024-04-06T03:49:51.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:51 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:51 smithi102 ceph-mon[32821]: pgmap v1104: 236 pgs: 236 active+clean; 4.4 MiB data, 764 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:49:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:49:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:51 smithi102 ceph-mon[32821]: osdmap e714: 8 total, 8 up, 8 in 2024-04-06T03:49:52.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:51 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:52.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:49:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:49:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]': finished 2024-04-06T03:49:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:52 smithi102 ceph-mon[32821]: osdmap e715: 8 total, 8 up, 8 in 2024-04-06T03:49:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:52.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:52 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]': finished 2024-04-06T03:49:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:52 smithi047 ceph-mon[29365]: osdmap e715: 8 total, 8 up, 8 in 2024-04-06T03:49:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:52.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:52 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]': finished 2024-04-06T03:49:52.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:52 smithi047 ceph-mon[37680]: osdmap e715: 8 total, 8 up, 8 in 2024-04-06T03:49:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:49:52.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:52 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-142"}]: dispatch 2024-04-06T03:49:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-mon[29365]: pgmap v1107: 236 pgs: 236 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:49:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-mon[29365]: osdmap e716: 8 total, 8 up, 8 in 2024-04-06T03:49:53.994 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:49:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:49:53.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:53.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-mon[37680]: pgmap v1107: 236 pgs: 236 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:49:53.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:53.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:53 smithi047 ceph-mon[37680]: osdmap e716: 8 total, 8 up, 8 in 2024-04-06T03:49:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:49:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:53 smithi102 ceph-mon[32821]: pgmap v1107: 236 pgs: 236 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:49:54.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:53 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:49:54.085 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:53 smithi102 ceph-mon[32821]: osdmap e716: 8 total, 8 up, 8 in 2024-04-06T03:49:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:54 smithi102 ceph-mon[32821]: osdmap e717: 8 total, 8 up, 8 in 2024-04-06T03:49:55.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:55.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:54 smithi047 ceph-mon[29365]: osdmap e717: 8 total, 8 up, 8 in 2024-04-06T03:49:55.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:55.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:54 smithi047 ceph-mon[37680]: osdmap e717: 8 total, 8 up, 8 in 2024-04-06T03:49:55.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:49:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:55 smithi102 ceph-mon[32821]: pgmap v1110: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:49:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:55 smithi102 ceph-mon[32821]: osdmap e718: 8 total, 8 up, 8 in 2024-04-06T03:49:56.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:56.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:55 smithi047 ceph-mon[37680]: pgmap v1110: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:49:56.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:56.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:55 smithi047 ceph-mon[37680]: osdmap e718: 8 total, 8 up, 8 in 2024-04-06T03:49:56.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:56.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:55 smithi047 ceph-mon[29365]: pgmap v1110: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-06T03:49:56.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:49:56.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:55 smithi047 ceph-mon[29365]: osdmap e718: 8 total, 8 up, 8 in 2024-04-06T03:49:56.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:49:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:56 smithi102 ceph-mon[32821]: osdmap e719: 8 total, 8 up, 8 in 2024-04-06T03:49:57.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:49:57.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:57.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:56 smithi047 ceph-mon[37680]: osdmap e719: 8 total, 8 up, 8 in 2024-04-06T03:49:57.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:49:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:49:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:56 smithi047 ceph-mon[29365]: osdmap e719: 8 total, 8 up, 8 in 2024-04-06T03:49:57.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:49:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:57 smithi102 ceph-mon[32821]: pgmap v1113: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:49:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-144"}]': finished 2024-04-06T03:49:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:57 smithi102 ceph-mon[32821]: osdmap e720: 8 total, 8 up, 8 in 2024-04-06T03:49:58.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-144", "mode": "readproxy"}]: dispatch 2024-04-06T03:49:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:57 smithi047 ceph-mon[29365]: pgmap v1113: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:49:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-144"}]': finished 2024-04-06T03:49:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:57 smithi047 ceph-mon[29365]: osdmap e720: 8 total, 8 up, 8 in 2024-04-06T03:49:58.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-144", "mode": "readproxy"}]: dispatch 2024-04-06T03:49:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:57 smithi047 ceph-mon[37680]: pgmap v1113: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:49:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-144"}]': finished 2024-04-06T03:49:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:57 smithi047 ceph-mon[37680]: osdmap e720: 8 total, 8 up, 8 in 2024-04-06T03:49:58.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-144", "mode": "readproxy"}]: dispatch 2024-04-06T03:49:59.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:58 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:59.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-144", "mode": "readproxy"}]': finished 2024-04-06T03:49:59.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:58 smithi102 ceph-mon[32821]: osdmap e721: 8 total, 8 up, 8 in 2024-04-06T03:49:59.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:58 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:59.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-144", "mode": "readproxy"}]': finished 2024-04-06T03:49:59.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:58 smithi047 ceph-mon[29365]: osdmap e721: 8 total, 8 up, 8 in 2024-04-06T03:49:59.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:58 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:49:59.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-144", "mode": "readproxy"}]': finished 2024-04-06T03:49:59.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:58 smithi047 ceph-mon[37680]: osdmap e721: 8 total, 8 up, 8 in 2024-04-06T03:50:00.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:49:59 smithi102 ceph-mon[32821]: pgmap v1116: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:50:00.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:49:59 smithi047 ceph-mon[29365]: pgmap v1116: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:50:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:49:59 smithi047 ceph-mon[37680]: pgmap v1116: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-06T03:50:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:00 smithi102 ceph-mon[32821]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 3 pool(s) do not have an application enabled 2024-04-06T03:50:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:00 smithi102 ceph-mon[32821]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-04-06T03:50:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:00 smithi102 ceph-mon[32821]: pool 'test-rados-api-smithi047-74676-144' with cache_mode readproxy needs hit_set_type to be set but it is not 2024-04-06T03:50:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:00 smithi102 ceph-mon[32821]: [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-04-06T03:50:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:00 smithi102 ceph-mon[32821]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T03:50:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:00 smithi102 ceph-mon[32821]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T03:50:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:00 smithi102 ceph-mon[32821]: application not enabled on pool 'test-rados-api-smithi047-74676-111' 2024-04-06T03:50:01.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:00 smithi102 ceph-mon[32821]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[29365]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 3 pool(s) do not have an application enabled 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[29365]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[29365]: pool 'test-rados-api-smithi047-74676-144' with cache_mode readproxy needs hit_set_type to be set but it is not 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[29365]: [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[29365]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[29365]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[29365]: application not enabled on pool 'test-rados-api-smithi047-74676-111' 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[29365]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T03:50:01.145 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[37680]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 3 pool(s) do not have an application enabled 2024-04-06T03:50:01.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[37680]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-04-06T03:50:01.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[37680]: pool 'test-rados-api-smithi047-74676-144' with cache_mode readproxy needs hit_set_type to be set but it is not 2024-04-06T03:50:01.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[37680]: [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-04-06T03:50:01.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[37680]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T03:50:01.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[37680]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T03:50:01.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[37680]: application not enabled on pool 'test-rados-api-smithi047-74676-111' 2024-04-06T03:50:01.146 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:00 smithi047 ceph-mon[37680]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T03:50:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:01 smithi102 ceph-mon[32821]: pgmap v1117: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 870 B/s rd, 174 B/s wr, 1 op/s 2024-04-06T03:50:02.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:01 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:02.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:01 smithi047 ceph-mon[29365]: pgmap v1117: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 870 B/s rd, 174 B/s wr, 1 op/s 2024-04-06T03:50:02.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:01 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:01 smithi047 ceph-mon[37680]: pgmap v1117: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 870 B/s rd, 174 B/s wr, 1 op/s 2024-04-06T03:50:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:01 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:02.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:50:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:50:04.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:04.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:03 smithi102 ceph-mon[32821]: pgmap v1118: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 148 B/s wr, 1 op/s 2024-04-06T03:50:04.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:04.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:03 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-mon[29365]: pgmap v1118: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 148 B/s wr, 1 op/s 2024-04-06T03:50:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:04.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:50:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:50:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-mon[37680]: pgmap v1118: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 148 B/s wr, 1 op/s 2024-04-06T03:50:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:03 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:06.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:05 smithi102 ceph-mon[32821]: pgmap v1119: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:50:06.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:05 smithi047 ceph-mon[29365]: pgmap v1119: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:50:06.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:05 smithi047 ceph-mon[37680]: pgmap v1119: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:50:08.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:07 smithi102 ceph-mon[32821]: pgmap v1120: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:50:08.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:07 smithi047 ceph-mon[29365]: pgmap v1120: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:50:08.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:07 smithi047 ceph-mon[37680]: pgmap v1120: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-06T03:50:09.086 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:08 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:09.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:08 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:09.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:08 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:09 smithi102 ceph-mon[32821]: pgmap v1121: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:50:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:09 smithi102 ceph-mon[32821]: osdmap e722: 8 total, 8 up, 8 in 2024-04-06T03:50:10.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:09 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:50:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:09 smithi047 ceph-mon[37680]: pgmap v1121: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:50:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:09 smithi047 ceph-mon[37680]: osdmap e722: 8 total, 8 up, 8 in 2024-04-06T03:50:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:09 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:50:10.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:09 smithi047 ceph-mon[29365]: pgmap v1121: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:50:10.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:10.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:09 smithi047 ceph-mon[29365]: osdmap e722: 8 total, 8 up, 8 in 2024-04-06T03:50:10.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:09 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:50:11.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:11 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:50:11.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]': finished 2024-04-06T03:50:11.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:11 smithi102 ceph-mon[32821]: osdmap e723: 8 total, 8 up, 8 in 2024-04-06T03:50:11.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:11.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:11 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:50:11.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:50:11.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]': finished 2024-04-06T03:50:11.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[29365]: osdmap e723: 8 total, 8 up, 8 in 2024-04-06T03:50:11.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:11.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:50:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:50:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]': finished 2024-04-06T03:50:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[37680]: osdmap e723: 8 total, 8 up, 8 in 2024-04-06T03:50:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:11.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:11 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-144"}]: dispatch 2024-04-06T03:50:12.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:12 smithi102 ceph-mon[32821]: pgmap v1124: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:50:12.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:12 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:12.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:12 smithi102 ceph-mon[32821]: osdmap e724: 8 total, 8 up, 8 in 2024-04-06T03:50:12.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:12 smithi102 ceph-mon[32821]: osdmap e725: 8 total, 8 up, 8 in 2024-04-06T03:50:12.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:12 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:12.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[29365]: pgmap v1124: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:50:12.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:12.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[29365]: osdmap e724: 8 total, 8 up, 8 in 2024-04-06T03:50:12.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[29365]: osdmap e725: 8 total, 8 up, 8 in 2024-04-06T03:50:12.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[37680]: pgmap v1124: 236 pgs: 236 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T03:50:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[37680]: osdmap e724: 8 total, 8 up, 8 in 2024-04-06T03:50:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[37680]: osdmap e725: 8 total, 8 up, 8 in 2024-04-06T03:50:12.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:12 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:12.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:50:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:50:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:13 smithi102 ceph-mon[32821]: pgmap v1127: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:50:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:13 smithi102 ceph-mon[32821]: osdmap e726: 8 total, 8 up, 8 in 2024-04-06T03:50:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:13 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:50:14.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:50:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:50:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[37680]: pgmap v1127: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:50:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[37680]: osdmap e726: 8 total, 8 up, 8 in 2024-04-06T03:50:14.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:50:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[29365]: pgmap v1127: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:50:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[29365]: osdmap e726: 8 total, 8 up, 8 in 2024-04-06T03:50:14.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:13 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:50:15.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:50:15.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:14 smithi102 ceph-mon[32821]: osdmap e727: 8 total, 8 up, 8 in 2024-04-06T03:50:15.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:14 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:15.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:50:15.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:14 smithi047 ceph-mon[29365]: osdmap e727: 8 total, 8 up, 8 in 2024-04-06T03:50:15.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:14 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:15.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:50:15.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:14 smithi047 ceph-mon[37680]: osdmap e727: 8 total, 8 up, 8 in 2024-04-06T03:50:15.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:14 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:15 smithi102 ceph-mon[32821]: pgmap v1130: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:50:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-146"}]': finished 2024-04-06T03:50:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:15 smithi102 ceph-mon[32821]: osdmap e728: 8 total, 8 up, 8 in 2024-04-06T03:50:16.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:15 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-146", "mode": "writeback"}]: dispatch 2024-04-06T03:50:16.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:15 smithi047 ceph-mon[29365]: pgmap v1130: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:50:16.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-146"}]': finished 2024-04-06T03:50:16.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:15 smithi047 ceph-mon[29365]: osdmap e728: 8 total, 8 up, 8 in 2024-04-06T03:50:16.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:15 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-146", "mode": "writeback"}]: dispatch 2024-04-06T03:50:16.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:15 smithi047 ceph-mon[37680]: pgmap v1130: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 770 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:50:16.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi047-74676-111", "overlaypool": "test-rados-api-smithi047-74676-146"}]': finished 2024-04-06T03:50:16.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:15 smithi047 ceph-mon[37680]: osdmap e728: 8 total, 8 up, 8 in 2024-04-06T03:50:16.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:15 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-146", "mode": "writeback"}]: dispatch 2024-04-06T03:50:17.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:50:17.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-146", "mode": "writeback"}]': finished 2024-04-06T03:50:17.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[29365]: osdmap e729: 8 total, 8 up, 8 in 2024-04-06T03:50:17.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:50:17.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:17.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:50:17.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-146", "mode": "writeback"}]': finished 2024-04-06T03:50:17.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[37680]: osdmap e729: 8 total, 8 up, 8 in 2024-04-06T03:50:17.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:50:17.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:16 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:17.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:16 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-06T03:50:17.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi047-74676-146", "mode": "writeback"}]': finished 2024-04-06T03:50:17.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:16 smithi102 ceph-mon[32821]: osdmap e729: 8 total, 8 up, 8 in 2024-04-06T03:50:17.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:16 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-06T03:50:17.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:16 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:18.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:17 smithi047 ceph-mon[29365]: pgmap v1133: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:50:18.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:50:18.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:17 smithi047 ceph-mon[29365]: osdmap e730: 8 total, 8 up, 8 in 2024-04-06T03:50:18.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:50:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:17 smithi047 ceph-mon[37680]: pgmap v1133: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:50:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:50:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:17 smithi047 ceph-mon[37680]: osdmap e730: 8 total, 8 up, 8 in 2024-04-06T03:50:18.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:50:18.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:17 smithi102 ceph-mon[32821]: pgmap v1133: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:50:18.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_count","val": "2"}]': finished 2024-04-06T03:50:18.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:17 smithi102 ceph-mon[32821]: osdmap e730: 8 total, 8 up, 8 in 2024-04-06T03:50:18.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-06T03:50:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:50:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[29365]: osdmap e731: 8 total, 8 up, 8 in 2024-04-06T03:50:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:50:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:19.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:50:19.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:50:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:50:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[37680]: osdmap e731: 8 total, 8 up, 8 in 2024-04-06T03:50:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:50:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:50:19.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:50:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_period","val": "600"}]': finished 2024-04-06T03:50:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:18 smithi102 ceph-mon[32821]: osdmap e731: 8 total, 8 up, 8 in 2024-04-06T03:50:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-06T03:50:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:18 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:18 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-06T03:50:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "hit_set_type","val": "bloom"}]': finished 2024-04-06T03:50:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:19 smithi047 ceph-mon[37680]: pgmap v1136: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:50:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:19 smithi047 ceph-mon[37680]: osdmap e732: 8 total, 8 up, 8 in 2024-04-06T03:50:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:50:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:50:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:19 smithi047 ceph-mon[29365]: pgmap v1136: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:50:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:19 smithi047 ceph-mon[29365]: osdmap e732: 8 total, 8 up, 8 in 2024-04-06T03:50:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:50:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:50:20.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:19 smithi102 ceph-mon[32821]: pgmap v1136: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-06T03:50:20.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:19 smithi102 ceph-mon[32821]: osdmap e732: 8 total, 8 up, 8 in 2024-04-06T03:50:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-06T03:50:20.335 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-06T03:50:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:20 smithi047 ceph-mon[37680]: osdmap e733: 8 total, 8 up, 8 in 2024-04-06T03:50:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:50:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:20 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "target_max_objects","val": "1"}]': finished 2024-04-06T03:50:21.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:20 smithi047 ceph-mon[37680]: osdmap e734: 8 total, 8 up, 8 in 2024-04-06T03:50:21.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:20 smithi047 ceph-mon[29365]: osdmap e733: 8 total, 8 up, 8 in 2024-04-06T03:50:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:50:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:20 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "target_max_objects","val": "1"}]': finished 2024-04-06T03:50:21.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:20 smithi047 ceph-mon[29365]: osdmap e734: 8 total, 8 up, 8 in 2024-04-06T03:50:21.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:20 smithi102 ceph-mon[32821]: osdmap e733: 8 total, 8 up, 8 in 2024-04-06T03:50:21.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-06T03:50:21.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:20 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-146","var": "target_max_objects","val": "1"}]': finished 2024-04-06T03:50:21.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:20 smithi102 ceph-mon[32821]: osdmap e734: 8 total, 8 up, 8 in 2024-04-06T03:50:22.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:21 smithi047 ceph-mon[29365]: pgmap v1139: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:21 smithi047 ceph-mon[37680]: pgmap v1139: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:22.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:21 smithi102 ceph-mon[32821]: pgmap v1139: 236 pgs: 236 active+clean; 4.4 MiB data, 775 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:22.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:50:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:50:23.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:22 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:50:23.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:22 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:23.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:22 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:23.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:22 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:50:23.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:22 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:23.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:22 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:23.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:22 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:50:23.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:22 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:23.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:22 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:50:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:50:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[29365]: pgmap v1141: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[29365]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[37680]: pgmap v1141: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[37680]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:50:24.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:23 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:23 smithi102 ceph-mon[32821]: pgmap v1141: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:23 smithi102 ceph-mon[32821]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-06T03:50:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:23 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:50:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:23 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:50:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:23 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:26.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:25 smithi047 ceph-mon[29365]: pgmap v1142: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:26.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:25 smithi047 ceph-mon[37680]: pgmap v1142: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:26.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:25 smithi102 ceph-mon[32821]: pgmap v1142: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:28.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:27 smithi047 ceph-mon[29365]: pgmap v1143: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:27 smithi047 ceph-mon[37680]: pgmap v1143: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:28.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:27 smithi102 ceph-mon[32821]: pgmap v1143: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:29.872 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:50:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=sqlstore.transactions t=2024-04-06T03:50:29.589976698Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-04-06T03:50:30.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:29 smithi047 ceph-mon[29365]: pgmap v1144: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:29 smithi047 ceph-mon[37680]: pgmap v1144: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:29 smithi102 ceph-mon[32821]: pgmap v1144: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:31.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:30 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:31.144 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:30 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:31.235 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:30 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:32.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:31 smithi047 ceph-mon[29365]: pgmap v1145: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:32.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:32.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:31 smithi047 ceph-mon[29365]: osdmap e735: 8 total, 8 up, 8 in 2024-04-06T03:50:32.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:31 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:32.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:31 smithi047 ceph-mon[37680]: pgmap v1145: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:32.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:32.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:31 smithi047 ceph-mon[37680]: osdmap e735: 8 total, 8 up, 8 in 2024-04-06T03:50:32.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:31 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:32.255 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:31 smithi102 ceph-mon[32821]: pgmap v1145: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-06T03:50:32.255 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:32.255 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:31 smithi102 ceph-mon[32821]: osdmap e735: 8 total, 8 up, 8 in 2024-04-06T03:50:32.255 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:31 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:32.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:50:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:50:33.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]': finished 2024-04-06T03:50:33.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:32 smithi047 ceph-mon[29365]: osdmap e736: 8 total, 8 up, 8 in 2024-04-06T03:50:33.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:33.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:32 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:33.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]': finished 2024-04-06T03:50:33.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:32 smithi047 ceph-mon[37680]: osdmap e736: 8 total, 8 up, 8 in 2024-04-06T03:50:33.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:33.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:32 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:33.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]': finished 2024-04-06T03:50:33.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:32 smithi102 ceph-mon[32821]: osdmap e736: 8 total, 8 up, 8 in 2024-04-06T03:50:33.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:33.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:32 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-146"}]: dispatch 2024-04-06T03:50:34.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:50:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:50:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[37680]: pgmap v1148: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[37680]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[37680]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[37680]: osdmap e737: 8 total, 8 up, 8 in 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[29365]: pgmap v1148: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[29365]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[29365]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[29365]: osdmap e737: 8 total, 8 up, 8 in 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:34.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:33 smithi102 ceph-mon[32821]: pgmap v1148: 236 pgs: 236 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-06T03:50:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:33 smithi102 ceph-mon[32821]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:33 smithi102 ceph-mon[32821]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-06T03:50:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:33 smithi102 ceph-mon[32821]: osdmap e737: 8 total, 8 up, 8 in 2024-04-06T03:50:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:50:34.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:35.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:34 smithi047 ceph-mon[29365]: osdmap e738: 8 total, 8 up, 8 in 2024-04-06T03:50:35.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:34 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:35.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:34 smithi047 ceph-mon[37680]: osdmap e738: 8 total, 8 up, 8 in 2024-04-06T03:50:35.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:34 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:35.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:34 smithi102 ceph-mon[32821]: osdmap e738: 8 total, 8 up, 8 in 2024-04-06T03:50:35.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:34 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:36.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:35 smithi047 ceph-mon[29365]: pgmap v1151: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:50:36.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:36.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:35 smithi047 ceph-mon[29365]: osdmap e739: 8 total, 8 up, 8 in 2024-04-06T03:50:36.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:35 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:50:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:35 smithi047 ceph-mon[37680]: pgmap v1151: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:50:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:35 smithi047 ceph-mon[37680]: osdmap e739: 8 total, 8 up, 8 in 2024-04-06T03:50:36.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:35 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:50:36.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:35 smithi102 ceph-mon[32821]: pgmap v1151: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 776 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:50:36.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:36.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:35 smithi102 ceph-mon[32821]: osdmap e739: 8 total, 8 up, 8 in 2024-04-06T03:50:36.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:35 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-06T03:50:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:50:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:36 smithi047 ceph-mon[29365]: osdmap e740: 8 total, 8 up, 8 in 2024-04-06T03:50:37.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:36 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]: dispatch 2024-04-06T03:50:37.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:50:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:36 smithi047 ceph-mon[37680]: osdmap e740: 8 total, 8 up, 8 in 2024-04-06T03:50:37.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:36 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]: dispatch 2024-04-06T03:50:37.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148", "force_nonempty": "--force-nonempty" }]': finished 2024-04-06T03:50:37.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:36 smithi102 ceph-mon[32821]: osdmap e740: 8 total, 8 up, 8 in 2024-04-06T03:50:37.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:36 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]: dispatch 2024-04-06T03:50:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[29365]: pgmap v1154: 236 pgs: 236 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:50:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]': finished 2024-04-06T03:50:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[29365]: osdmap e741: 8 total, 8 up, 8 in 2024-04-06T03:50:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]: dispatch 2024-04-06T03:50:38.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[37680]: pgmap v1154: 236 pgs: 236 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:50:38.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]': finished 2024-04-06T03:50:38.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[37680]: osdmap e741: 8 total, 8 up, 8 in 2024-04-06T03:50:38.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:38.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]: dispatch 2024-04-06T03:50:38.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:38 smithi102 ceph-mon[32821]: pgmap v1154: 236 pgs: 236 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-06T03:50:38.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]': finished 2024-04-06T03:50:38.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:38 smithi102 ceph-mon[32821]: osdmap e741: 8 total, 8 up, 8 in 2024-04-06T03:50:38.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:38.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-148"}]: dispatch 2024-04-06T03:50:39.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:39 smithi047 ceph-mon[29365]: osdmap e742: 8 total, 8 up, 8 in 2024-04-06T03:50:39.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:39 smithi047 ceph-mon[29365]: osdmap e743: 8 total, 8 up, 8 in 2024-04-06T03:50:39.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:39.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:39 smithi047 ceph-mon[37680]: osdmap e742: 8 total, 8 up, 8 in 2024-04-06T03:50:39.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:39 smithi047 ceph-mon[37680]: osdmap e743: 8 total, 8 up, 8 in 2024-04-06T03:50:39.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:39.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:39 smithi102 ceph-mon[32821]: osdmap e742: 8 total, 8 up, 8 in 2024-04-06T03:50:39.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:39 smithi102 ceph-mon[32821]: osdmap e743: 8 total, 8 up, 8 in 2024-04-06T03:50:39.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[29365]: pgmap v1157: 204 pgs: 204 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:50:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[29365]: osdmap e744: 8 total, 8 up, 8 in 2024-04-06T03:50:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-150"}]: dispatch 2024-04-06T03:50:40.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[37680]: pgmap v1157: 204 pgs: 204 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:50:40.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:40.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[37680]: osdmap e744: 8 total, 8 up, 8 in 2024-04-06T03:50:40.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:40.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:40 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-150"}]: dispatch 2024-04-06T03:50:40.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:40 smithi102 ceph-mon[32821]: pgmap v1157: 204 pgs: 204 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-06T03:50:40.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:40.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:40 smithi102 ceph-mon[32821]: osdmap e744: 8 total, 8 up, 8 in 2024-04-06T03:50:40.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:40.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:40 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-150"}]: dispatch 2024-04-06T03:50:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:41 smithi047 ceph-mon[29365]: pgmap v1160: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:41 smithi047 ceph-mon[29365]: osdmap e745: 8 total, 8 up, 8 in 2024-04-06T03:50:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:41 smithi047 ceph-mon[29365]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:41 smithi047 ceph-mon[37680]: pgmap v1160: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:41 smithi047 ceph-mon[37680]: osdmap e745: 8 total, 8 up, 8 in 2024-04-06T03:50:42.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:41 smithi047 ceph-mon[37680]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:41 smithi102 ceph-mon[32821]: pgmap v1160: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 798 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:41 smithi102 ceph-mon[32821]: osdmap e745: 8 total, 8 up, 8 in 2024-04-06T03:50:42.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:41 smithi102 ceph-mon[32821]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:42.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:50:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:50:43.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:42 smithi047 ceph-mon[29365]: osdmap e746: 8 total, 8 up, 8 in 2024-04-06T03:50:43.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:43.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:43.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:42 smithi047 ceph-mon[29365]: osdmap e747: 8 total, 8 up, 8 in 2024-04-06T03:50:43.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:42 smithi047 ceph-mon[37680]: osdmap e746: 8 total, 8 up, 8 in 2024-04-06T03:50:43.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:43.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:43.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:42 smithi047 ceph-mon[37680]: osdmap e747: 8 total, 8 up, 8 in 2024-04-06T03:50:43.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:42 smithi102 ceph-mon[32821]: osdmap e746: 8 total, 8 up, 8 in 2024-04-06T03:50:43.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:43.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:43.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:42 smithi102 ceph-mon[32821]: osdmap e747: 8 total, 8 up, 8 in 2024-04-06T03:50:44.198 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:50:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:50:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:50:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[29365]: pgmap v1163: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 800 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:50:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-152"}]: dispatch 2024-04-06T03:50:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[29365]: osdmap e748: 8 total, 8 up, 8 in 2024-04-06T03:50:44.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:44.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[37680]: pgmap v1163: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 800 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:50:44.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:44.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-152"}]: dispatch 2024-04-06T03:50:44.494 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:44 smithi047 ceph-mon[37680]: osdmap e748: 8 total, 8 up, 8 in 2024-04-06T03:50:44.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:44.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:44 smithi102 ceph-mon[32821]: pgmap v1163: 236 pgs: 32 unknown, 204 active+clean; 4.4 MiB data, 800 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:50:44.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:44.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-152"}]: dispatch 2024-04-06T03:50:44.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:44 smithi102 ceph-mon[32821]: osdmap e748: 8 total, 8 up, 8 in 2024-04-06T03:50:46.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:45 smithi047 ceph-mon[37680]: pgmap v1166: 204 pgs: 204 active+clean; 4.4 MiB data, 800 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:50:46.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:45 smithi047 ceph-mon[37680]: osdmap e749: 8 total, 8 up, 8 in 2024-04-06T03:50:46.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:45 smithi047 ceph-mon[29365]: pgmap v1166: 204 pgs: 204 active+clean; 4.4 MiB data, 800 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:50:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:45 smithi047 ceph-mon[29365]: osdmap e749: 8 total, 8 up, 8 in 2024-04-06T03:50:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:46.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:45 smithi102 ceph-mon[32821]: pgmap v1166: 204 pgs: 204 active+clean; 4.4 MiB data, 800 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T03:50:46.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:45 smithi102 ceph-mon[32821]: osdmap e749: 8 total, 8 up, 8 in 2024-04-06T03:50:46.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[37680]: osdmap e750: 8 total, 8 up, 8 in 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-111","var": "dedup_tier","val": "test-rados-api-smithi047-74676-154"}]: dispatch 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-154"}]: dispatch 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[29365]: osdmap e750: 8 total, 8 up, 8 in 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-111","var": "dedup_tier","val": "test-rados-api-smithi047-74676-154"}]: dispatch 2024-04-06T03:50:47.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:47.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-154"}]: dispatch 2024-04-06T03:50:47.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi047-74676-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-06T03:50:47.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:46 smithi102 ceph-mon[32821]: osdmap e750: 8 total, 8 up, 8 in 2024-04-06T03:50:47.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi047-74676-111","var": "dedup_tier","val": "test-rados-api-smithi047-74676-154"}]: dispatch 2024-04-06T03:50:47.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:47.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi047-74676-111", "tierpool": "test-rados-api-smithi047-74676-154"}]: dispatch 2024-04-06T03:50:48.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:47 smithi047 ceph-mon[37680]: pgmap v1169: 236 pgs: 236 active+clean; 4.4 MiB data, 818 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-06T03:50:48.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:47 smithi047 ceph-mon[37680]: osdmap e751: 8 total, 8 up, 8 in 2024-04-06T03:50:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:47 smithi047 ceph-mon[29365]: pgmap v1169: 236 pgs: 236 active+clean; 4.4 MiB data, 818 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-06T03:50:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:47 smithi047 ceph-mon[29365]: osdmap e751: 8 total, 8 up, 8 in 2024-04-06T03:50:48.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:47 smithi102 ceph-mon[32821]: pgmap v1169: 236 pgs: 236 active+clean; 4.4 MiB data, 818 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-06T03:50:48.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:47 smithi102 ceph-mon[32821]: osdmap e751: 8 total, 8 up, 8 in 2024-04-06T03:50:49.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:48 smithi047 ceph-mon[29365]: osdmap e752: 8 total, 8 up, 8 in 2024-04-06T03:50:49.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:48 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:49.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:49.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:48 smithi047 ceph-mon[37680]: osdmap e752: 8 total, 8 up, 8 in 2024-04-06T03:50:49.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:48 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:49.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:49.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:48 smithi102 ceph-mon[32821]: osdmap e752: 8 total, 8 up, 8 in 2024-04-06T03:50:49.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:48 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:49.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:50:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7855 ms) 2024-04-06T03:50:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-06T03:50:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (12152 ms) 2024-04-06T03:50:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-04-06T03:50:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8052 ms) 2024-04-06T03:50:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-06T03:50:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13076 ms) 2024-04-06T03:50:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7724 ms) 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8046 ms) 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: hmm, no HitSet yet 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: ok, hit_set contains 337:602f83fe:::foo:head 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9043 ms) 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,0 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: first is 1712375365 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,0 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,0 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,0 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,0 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,0 2024-04-06T03:50:49.987 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,1712375370,1712375371,0 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,1712375370,1712375371,0 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,1712375370,1712375371,0 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,1712375370,1712375371,1712375373,1712375374,0 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,1712375370,1712375371,1712375373,1712375374,0 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375365,1712375367,1712375368,1712375370,1712375371,1712375373,1712375374,0 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: got ls 1712375368,1712375370,1712375371,1712375373,1712375374,1712375376,1712375377,0 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: first now 1712375368, trimmed 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (21065 ms) 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: foo0 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14061 ms) 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (18067 ms) 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-04-06T03:50:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (22088 ms) 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5025 ms) 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3004 ms) 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3017 ms) 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3022 ms) 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (229974 ms total) 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (859271 ms total) 2024-04-06T03:50:49.989 INFO:tasks.workunit.client.0.smithi047.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-04-06T03:50:49.991 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.991 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74449 2024-04-06T03:50:49.991 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74449 2024-04-06T03:50:49.991 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.991 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74669 2024-04-06T03:50:49.991 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74669 2024-04-06T03:50:49.991 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75215 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75215 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74886 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74886 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74756 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74756 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74527 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74527 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74848 2024-04-06T03:50:49.992 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74848 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75435 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75435 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75469 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75469 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74540 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74540 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75280 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75280 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75089 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75089 2024-04-06T03:50:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74424 2024-04-06T03:50:49.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74424 2024-04-06T03:50:49.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74487 2024-04-06T03:50:49.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74487 2024-04-06T03:50:49.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T03:50:49.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75150 2024-04-06T03:50:49.994 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75150 2024-04-06T03:50:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[37680]: pgmap v1172: 196 pgs: 196 active+clean; 582 KiB data, 818 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[37680]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[37680]: osdmap e753: 8 total, 8 up, 8 in 2024-04-06T03:50:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[29365]: pgmap v1172: 196 pgs: 196 active+clean; 582 KiB data, 818 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[29365]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[29365]: osdmap e753: 8 total, 8 up, 8 in 2024-04-06T03:50:50.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:49 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:49 smithi102 ceph-mon[32821]: pgmap v1172: 196 pgs: 196 active+clean; 582 KiB data, 818 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:49 smithi102 ceph-mon[32821]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T03:50:50.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:50.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:49 smithi102 ceph-mon[32821]: osdmap e753: 8 total, 8 up, 8 in 2024-04-06T03:50:50.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:49 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]: dispatch 2024-04-06T03:50:51.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:50 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:51.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:50 smithi047 ceph-mon[37680]: osdmap e754: 8 total, 8 up, 8 in 2024-04-06T03:50:51.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:50 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:51.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:50 smithi047 ceph-mon[29365]: osdmap e754: 8 total, 8 up, 8 in 2024-04-06T03:50:51.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:50 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2972200208' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi047-74676-111"}]': finished 2024-04-06T03:50:51.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:50 smithi102 ceph-mon[32821]: osdmap e754: 8 total, 8 up, 8 in 2024-04-06T03:50:52.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:51 smithi047 ceph-mon[29365]: pgmap v1175: 196 pgs: 196 active+clean; 582 KiB data, 818 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:52.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:51 smithi047 ceph-mon[37680]: pgmap v1175: 196 pgs: 196 active+clean; 582 KiB data, 818 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:52.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:51 smithi102 ceph-mon[32821]: pgmap v1175: 196 pgs: 196 active+clean; 582 KiB data, 818 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:52.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:50:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:50:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:53 smithi047 ceph-mon[29365]: pgmap v1176: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:50:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:50:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:50:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:54.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:53 smithi047 ceph-mon[37680]: pgmap v1176: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:50:54.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:53 smithi102 ceph-mon[32821]: pgmap v1176: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail 2024-04-06T03:50:56.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:55 smithi047 ceph-mon[29365]: pgmap v1177: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 766 B/s rd, 0 op/s 2024-04-06T03:50:56.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:55 smithi047 ceph-mon[37680]: pgmap v1177: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 766 B/s rd, 0 op/s 2024-04-06T03:50:56.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:55 smithi102 ceph-mon[32821]: pgmap v1177: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 766 B/s rd, 0 op/s 2024-04-06T03:50:58.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:57 smithi102 ceph-mon[32821]: pgmap v1178: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:50:58.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:57 smithi047 ceph-mon[29365]: pgmap v1178: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:50:58.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:57 smithi047 ceph-mon[37680]: pgmap v1178: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:50:59 smithi102 ceph-mon[32821]: pgmap v1179: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:51:00.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:50:59 smithi047 ceph-mon[37680]: pgmap v1179: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:51:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:50:59 smithi047 ceph-mon[29365]: pgmap v1179: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T03:51:02.295 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:02 smithi047 ceph-mon[37680]: pgmap v1180: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-04-06T03:51:02.295 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:02 smithi047 ceph-mon[29365]: pgmap v1180: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-04-06T03:51:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:02 smithi102 ceph-mon[32821]: pgmap v1180: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-04-06T03:51:02.834 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:51:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:51:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:04 smithi047 ceph-mon[29365]: pgmap v1181: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:04.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:51:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:51:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:51:04.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:04.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:04 smithi047 ceph-mon[37680]: pgmap v1181: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:04.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:04 smithi102 ceph-mon[32821]: pgmap v1181: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:04.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:06.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:06 smithi102 ceph-mon[32821]: pgmap v1182: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:06.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:06 smithi047 ceph-mon[29365]: pgmap v1182: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:06 smithi047 ceph-mon[37680]: pgmap v1182: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:08.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:08 smithi102 ceph-mon[32821]: pgmap v1183: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:08.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:08 smithi047 ceph-mon[29365]: pgmap v1183: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:08.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:08 smithi047 ceph-mon[37680]: pgmap v1183: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:10.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:10 smithi102 ceph-mon[32821]: pgmap v1184: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:10.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:10 smithi047 ceph-mon[29365]: pgmap v1184: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:10.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:10 smithi047 ceph-mon[37680]: pgmap v1184: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:12.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:12 smithi102 ceph-mon[32821]: pgmap v1185: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:12.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:12 smithi047 ceph-mon[29365]: pgmap v1185: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:12.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:12 smithi047 ceph-mon[37680]: pgmap v1185: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:12.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:51:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:51:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:14.274 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:14 smithi047 ceph-mon[29365]: pgmap v1186: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:14.275 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:51:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:51:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:51:14.275 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:14.275 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:14 smithi047 ceph-mon[37680]: pgmap v1186: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:14.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:14 smithi102 ceph-mon[32821]: pgmap v1186: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:16.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:16 smithi102 ceph-mon[32821]: pgmap v1187: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:16.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:16 smithi047 ceph-mon[29365]: pgmap v1187: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:16.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:16 smithi047 ceph-mon[37680]: pgmap v1187: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:18 smithi102 ceph-mon[32821]: pgmap v1188: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:18 smithi047 ceph-mon[29365]: pgmap v1188: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:18.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:18 smithi047 ceph-mon[37680]: pgmap v1188: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:19.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:19.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:19.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:20.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:20 smithi102 ceph-mon[32821]: pgmap v1189: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:20.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:20 smithi047 ceph-mon[29365]: pgmap v1189: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:20.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:20 smithi047 ceph-mon[37680]: pgmap v1189: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:22.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:22 smithi102 ceph-mon[32821]: pgmap v1190: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:22.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:22 smithi047 ceph-mon[37680]: pgmap v1190: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:22.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:22 smithi047 ceph-mon[29365]: pgmap v1190: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:22.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:51:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:51:24.036 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:51:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:51:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:51:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:24 smithi102 ceph-mon[32821]: pgmap v1191: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:24 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:51:24.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:24.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:24 smithi047 ceph-mon[29365]: pgmap v1191: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:24.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:24 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:51:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:24 smithi047 ceph-mon[37680]: pgmap v1191: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:24 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:51:25.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:51:25.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:51:25.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:51:25.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:51:25.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:51:25.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:51:25.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:51:25.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:51:25.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:51:26.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:26 smithi047 ceph-mon[29365]: pgmap v1192: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:26.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:26 smithi047 ceph-mon[37680]: pgmap v1192: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:26.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:26 smithi102 ceph-mon[32821]: pgmap v1192: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:28.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:28 smithi047 ceph-mon[29365]: pgmap v1193: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:28.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:28 smithi047 ceph-mon[37680]: pgmap v1193: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:28 smithi102 ceph-mon[32821]: pgmap v1193: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:30.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:30 smithi047 ceph-mon[29365]: pgmap v1194: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:30.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:30 smithi047 ceph-mon[37680]: pgmap v1194: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:30 smithi102 ceph-mon[32821]: pgmap v1194: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:32.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:32 smithi047 ceph-mon[29365]: pgmap v1195: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:32.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:32 smithi047 ceph-mon[37680]: pgmap v1195: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:32.575 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:32 smithi102 ceph-mon[32821]: pgmap v1195: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:32.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:51:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:51:34.228 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:51:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:51:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:51:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:34 smithi047 ceph-mon[37680]: pgmap v1196: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:34 smithi047 ceph-mon[29365]: pgmap v1196: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:34.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:34.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:34 smithi102 ceph-mon[32821]: pgmap v1196: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:34.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:36.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:36 smithi047 ceph-mon[29365]: pgmap v1197: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:36.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:36 smithi047 ceph-mon[37680]: pgmap v1197: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:36.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:36 smithi102 ceph-mon[32821]: pgmap v1197: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:38 smithi047 ceph-mon[29365]: pgmap v1198: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:38.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:38 smithi047 ceph-mon[37680]: pgmap v1198: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:38 smithi102 ceph-mon[32821]: pgmap v1198: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:40.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:40 smithi047 ceph-mon[29365]: pgmap v1199: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:51:40.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:40 smithi047 ceph-mon[37680]: pgmap v1199: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:51:40.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:40 smithi102 ceph-mon[32821]: pgmap v1199: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:51:42.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:42 smithi047 ceph-mon[29365]: pgmap v1200: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:42.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:42 smithi047 ceph-mon[37680]: pgmap v1200: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:42.580 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:42 smithi102 ceph-mon[32821]: pgmap v1200: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:42.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:51:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:51:44.241 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:51:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:51:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:51:44.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:44.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:44 smithi047 ceph-mon[37680]: pgmap v1201: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:44 smithi047 ceph-mon[29365]: pgmap v1201: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:44.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:44 smithi102 ceph-mon[32821]: pgmap v1201: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:46 smithi102 ceph-mon[32821]: pgmap v1202: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:46.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:46 smithi047 ceph-mon[29365]: pgmap v1202: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:46.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:46 smithi047 ceph-mon[37680]: pgmap v1202: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:48 smithi102 ceph-mon[32821]: pgmap v1203: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:48.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:48 smithi047 ceph-mon[29365]: pgmap v1203: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:48.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:48 smithi047 ceph-mon[37680]: pgmap v1203: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:49.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:49.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:49.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:51:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:50 smithi102 ceph-mon[32821]: pgmap v1204: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:50.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:50 smithi047 ceph-mon[37680]: pgmap v1204: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:50.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:50 smithi047 ceph-mon[29365]: pgmap v1204: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:52.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:52 smithi102 ceph-mon[32821]: pgmap v1205: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:52.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:52 smithi047 ceph-mon[37680]: pgmap v1205: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:52.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:52 smithi047 ceph-mon[29365]: pgmap v1205: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:53.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:51:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:51:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:51:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:51:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:51:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:54.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:54 smithi102 ceph-mon[32821]: pgmap v1206: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:54.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:54.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:54 smithi047 ceph-mon[37680]: pgmap v1206: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:54.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:51:54.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:54 smithi047 ceph-mon[29365]: pgmap v1206: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:56.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:56 smithi102 ceph-mon[32821]: pgmap v1207: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:56.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:56 smithi047 ceph-mon[29365]: pgmap v1207: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:56.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:56 smithi047 ceph-mon[37680]: pgmap v1207: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:51:58.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:51:58 smithi102 ceph-mon[32821]: pgmap v1208: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:58.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:51:58 smithi047 ceph-mon[29365]: pgmap v1208: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:51:58.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:51:58 smithi047 ceph-mon[37680]: pgmap v1208: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:00 smithi102 ceph-mon[32821]: pgmap v1209: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:00.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:00 smithi047 ceph-mon[29365]: pgmap v1209: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:00.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:00 smithi047 ceph-mon[37680]: pgmap v1209: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:02.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:02 smithi047 ceph-mon[29365]: pgmap v1210: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:02.545 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:02 smithi047 ceph-mon[37680]: pgmap v1210: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:02.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:02 smithi102 ceph-mon[32821]: pgmap v1210: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:03.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:52:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:52:04.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:52:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:52:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:52:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:04.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:04 smithi102 ceph-mon[32821]: pgmap v1211: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:04.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:04.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:04.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:04 smithi047 ceph-mon[37680]: pgmap v1211: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:04.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:04.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:04.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:04 smithi047 ceph-mon[29365]: pgmap v1211: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:04.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:06 smithi102 ceph-mon[32821]: pgmap v1212: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:06.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:06 smithi047 ceph-mon[29365]: pgmap v1212: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:06.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:06 smithi047 ceph-mon[37680]: pgmap v1212: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:08.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:08 smithi102 ceph-mon[32821]: pgmap v1213: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:08 smithi047 ceph-mon[29365]: pgmap v1213: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:08.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:08 smithi047 ceph-mon[37680]: pgmap v1213: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:10 smithi102 ceph-mon[32821]: pgmap v1214: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:10 smithi047 ceph-mon[29365]: pgmap v1214: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:10.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:10 smithi047 ceph-mon[37680]: pgmap v1214: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:12.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:12 smithi102 ceph-mon[32821]: pgmap v1215: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:12.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:12 smithi047 ceph-mon[37680]: pgmap v1215: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:12.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:12 smithi047 ceph-mon[29365]: pgmap v1215: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:13.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:52:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:52:14.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:52:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:52:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:52:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:14.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:14 smithi102 ceph-mon[32821]: pgmap v1216: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:14.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:14.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:14 smithi047 ceph-mon[29365]: pgmap v1216: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:14.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:14.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:14 smithi047 ceph-mon[37680]: pgmap v1216: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:16.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:16 smithi102 ceph-mon[32821]: pgmap v1217: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:16.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:16 smithi047 ceph-mon[37680]: pgmap v1217: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:16.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:16 smithi047 ceph-mon[29365]: pgmap v1217: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:17.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:17 smithi102 ceph-mon[32821]: pgmap v1218: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:17.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:17 smithi047 ceph-mon[29365]: pgmap v1218: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:17.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:17 smithi047 ceph-mon[37680]: pgmap v1218: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:19.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:19 smithi047 ceph-mon[29365]: pgmap v1219: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:19.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:19.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:19 smithi047 ceph-mon[37680]: pgmap v1219: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:19.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:20.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:19 smithi102 ceph-mon[32821]: pgmap v1219: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:20.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:21.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:21 smithi047 ceph-mon[29365]: pgmap v1220: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:21.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:21 smithi047 ceph-mon[37680]: pgmap v1220: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:21 smithi102 ceph-mon[32821]: pgmap v1220: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:52:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:52:23.992 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:52:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:52:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:52:23.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:23.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:23 smithi047 ceph-mon[29365]: pgmap v1221: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:23.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:23.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:23 smithi047 ceph-mon[37680]: pgmap v1221: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:24.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:23 smithi102 ceph-mon[32821]: pgmap v1221: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:24.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:24 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:52:24.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:24 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:52:25.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:24 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:52:25.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:25 smithi047 ceph-mon[37680]: pgmap v1222: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:25.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:52:25.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:52:25.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:52:25.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:25 smithi047 ceph-mon[29365]: pgmap v1222: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:25.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:52:25.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:52:25.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:52:26.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:25 smithi102 ceph-mon[32821]: pgmap v1222: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:26.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:52:26.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:52:26.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:52:28.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:27 smithi102 ceph-mon[32821]: pgmap v1223: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:28.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:27 smithi047 ceph-mon[29365]: pgmap v1223: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:27 smithi047 ceph-mon[37680]: pgmap v1223: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:30.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:29 smithi102 ceph-mon[32821]: pgmap v1224: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:30.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:29 smithi047 ceph-mon[29365]: pgmap v1224: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:29 smithi047 ceph-mon[37680]: pgmap v1224: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:32.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:31 smithi047 ceph-mon[29365]: pgmap v1225: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:32.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:31 smithi047 ceph-mon[37680]: pgmap v1225: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:32.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:31 smithi102 ceph-mon[32821]: pgmap v1225: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:32.985 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:52:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:52:34.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:34.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:33 smithi102 ceph-mon[32821]: pgmap v1226: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:34.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:34.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:33 smithi047 ceph-mon[29365]: pgmap v1226: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:34.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:52:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:52:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:52:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:33 smithi047 ceph-mon[37680]: pgmap v1226: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:35.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:35.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:35.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:36.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:35 smithi102 ceph-mon[32821]: pgmap v1227: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:36.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:35 smithi047 ceph-mon[29365]: pgmap v1227: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:35 smithi047 ceph-mon[37680]: pgmap v1227: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:38.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:37 smithi102 ceph-mon[32821]: pgmap v1228: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:38.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:37 smithi047 ceph-mon[29365]: pgmap v1228: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:38.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:37 smithi047 ceph-mon[37680]: pgmap v1228: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:40.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:39 smithi102 ceph-mon[32821]: pgmap v1229: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:40.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:39 smithi047 ceph-mon[29365]: pgmap v1229: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:40.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:39 smithi047 ceph-mon[37680]: pgmap v1229: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:42.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:41 smithi102 ceph-mon[32821]: pgmap v1230: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:42.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:41 smithi047 ceph-mon[29365]: pgmap v1230: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:42.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:41 smithi047 ceph-mon[37680]: pgmap v1230: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:43.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:52:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:52:44.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:44.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:43 smithi102 ceph-mon[32821]: pgmap v1231: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:43 smithi047 ceph-mon[29365]: pgmap v1231: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:44.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:52:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:52:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:52:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:43 smithi047 ceph-mon[37680]: pgmap v1231: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:46.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:45 smithi102 ceph-mon[32821]: pgmap v1232: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:45 smithi047 ceph-mon[29365]: pgmap v1232: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:46.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:45 smithi047 ceph-mon[37680]: pgmap v1232: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:48.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:47 smithi102 ceph-mon[32821]: pgmap v1233: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:47 smithi047 ceph-mon[29365]: pgmap v1233: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:48.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:47 smithi047 ceph-mon[37680]: pgmap v1233: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:50.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:49 smithi102 ceph-mon[32821]: pgmap v1234: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:50.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:50.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:49 smithi047 ceph-mon[29365]: pgmap v1234: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:49 smithi047 ceph-mon[37680]: pgmap v1234: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:52:52.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:51 smithi102 ceph-mon[32821]: pgmap v1235: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:52.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:51 smithi047 ceph-mon[29365]: pgmap v1235: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:52.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:51 smithi047 ceph-mon[37680]: pgmap v1235: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:53.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:52:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:52:54.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:54.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:53 smithi102 ceph-mon[32821]: pgmap v1236: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:54.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:52:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:52:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:52:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:53 smithi047 ceph-mon[29365]: pgmap v1236: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:52:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:53 smithi047 ceph-mon[37680]: pgmap v1236: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:56.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:55 smithi102 ceph-mon[32821]: pgmap v1237: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:56.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:55 smithi047 ceph-mon[29365]: pgmap v1237: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:56.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:55 smithi047 ceph-mon[37680]: pgmap v1237: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:52:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:57 smithi102 ceph-mon[32821]: pgmap v1238: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:58.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:57 smithi047 ceph-mon[29365]: pgmap v1238: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:52:58.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:57 smithi047 ceph-mon[37680]: pgmap v1238: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:00.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:52:59 smithi102 ceph-mon[32821]: pgmap v1239: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:52:59 smithi047 ceph-mon[29365]: pgmap v1239: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:52:59 smithi047 ceph-mon[37680]: pgmap v1239: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:02.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:01 smithi102 ceph-mon[32821]: pgmap v1240: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:02.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:01 smithi047 ceph-mon[29365]: pgmap v1240: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:01 smithi047 ceph-mon[37680]: pgmap v1240: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:02.985 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:53:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:53:04.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:04.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:03 smithi102 ceph-mon[32821]: pgmap v1241: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:04.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:53:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:53:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:53:04.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:04.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:03 smithi047 ceph-mon[37680]: pgmap v1241: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:03 smithi047 ceph-mon[29365]: pgmap v1241: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:05.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:05.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:05.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:06.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:05 smithi102 ceph-mon[32821]: pgmap v1242: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:06.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:05 smithi047 ceph-mon[29365]: pgmap v1242: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:06.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:05 smithi047 ceph-mon[37680]: pgmap v1242: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:08.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:07 smithi102 ceph-mon[32821]: pgmap v1243: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:08.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:07 smithi047 ceph-mon[29365]: pgmap v1243: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:08.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:07 smithi047 ceph-mon[37680]: pgmap v1243: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:10.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:09 smithi102 ceph-mon[32821]: pgmap v1244: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:10.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:09 smithi047 ceph-mon[29365]: pgmap v1244: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:09 smithi047 ceph-mon[37680]: pgmap v1244: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:12.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:11 smithi102 ceph-mon[32821]: pgmap v1245: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:12.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:11 smithi047 ceph-mon[29365]: pgmap v1245: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:12.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:11 smithi047 ceph-mon[37680]: pgmap v1245: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:13.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:53:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:53:14.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:14.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:13 smithi102 ceph-mon[32821]: pgmap v1246: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:14.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:53:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:53:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:53:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:13 smithi047 ceph-mon[37680]: pgmap v1246: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:13 smithi047 ceph-mon[29365]: pgmap v1246: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:16.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:15 smithi102 ceph-mon[32821]: pgmap v1247: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:16.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:15 smithi047 ceph-mon[29365]: pgmap v1247: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:16.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:15 smithi047 ceph-mon[37680]: pgmap v1247: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:18.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:17 smithi102 ceph-mon[32821]: pgmap v1248: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:18.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:17 smithi047 ceph-mon[29365]: pgmap v1248: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:18.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:17 smithi047 ceph-mon[37680]: pgmap v1248: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:20.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:19 smithi102 ceph-mon[32821]: pgmap v1249: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:20.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:19 smithi047 ceph-mon[29365]: pgmap v1249: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:19 smithi047 ceph-mon[37680]: pgmap v1249: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:21 smithi102 ceph-mon[32821]: pgmap v1250: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:22.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:21 smithi047 ceph-mon[29365]: pgmap v1250: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:21 smithi047 ceph-mon[37680]: pgmap v1250: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:53:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:53:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:24.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:23 smithi102 ceph-mon[32821]: pgmap v1251: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:24.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:23 smithi047 ceph-mon[29365]: pgmap v1251: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:53:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:53:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:53:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:23 smithi047 ceph-mon[37680]: pgmap v1251: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[37680]: pgmap v1252: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[29365]: pgmap v1252: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:53:26.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:53:26.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:53:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:25 smithi102 ceph-mon[32821]: pgmap v1252: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:53:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:53:26.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:53:26.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:53:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:27 smithi047 ceph-mon[29365]: pgmap v1253: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:27 smithi047 ceph-mon[37680]: pgmap v1253: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:28.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:27 smithi102 ceph-mon[32821]: pgmap v1253: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:30.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:29 smithi047 ceph-mon[29365]: pgmap v1254: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:29 smithi047 ceph-mon[37680]: pgmap v1254: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:29 smithi102 ceph-mon[32821]: pgmap v1254: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:32.135 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:31 smithi102 ceph-mon[32821]: pgmap v1255: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:32.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:31 smithi047 ceph-mon[29365]: pgmap v1255: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:32.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:31 smithi047 ceph-mon[37680]: pgmap v1255: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:33.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:53:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:53:34.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:34.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:33 smithi047 ceph-mon[29365]: pgmap v1256: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:34.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:53:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:53:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:53:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:33 smithi047 ceph-mon[37680]: pgmap v1256: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:33 smithi102 ceph-mon[32821]: pgmap v1256: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:35.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:35.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:36.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:35 smithi047 ceph-mon[29365]: pgmap v1257: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:35 smithi047 ceph-mon[37680]: pgmap v1257: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:36.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:35 smithi102 ceph-mon[32821]: pgmap v1257: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:38.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:37 smithi047 ceph-mon[29365]: pgmap v1258: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:38.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:37 smithi047 ceph-mon[37680]: pgmap v1258: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:38.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:37 smithi102 ceph-mon[32821]: pgmap v1258: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:40.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:39 smithi047 ceph-mon[29365]: pgmap v1259: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:40.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:39 smithi047 ceph-mon[37680]: pgmap v1259: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:39 smithi102 ceph-mon[32821]: pgmap v1259: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:42.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:41 smithi047 ceph-mon[29365]: pgmap v1260: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:42.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:41 smithi047 ceph-mon[37680]: pgmap v1260: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:41 smithi102 ceph-mon[32821]: pgmap v1260: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T03:53:43.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:53:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:53:44.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:43 smithi047 ceph-mon[29365]: pgmap v1261: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:43 smithi047 ceph-mon[37680]: pgmap v1261: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:44.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:53:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:53:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:53:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:43 smithi102 ceph-mon[32821]: pgmap v1261: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:46.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:45 smithi047 ceph-mon[37680]: pgmap v1262: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:53:46.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:45 smithi047 ceph-mon[29365]: pgmap v1262: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:53:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:45 smithi102 ceph-mon[32821]: pgmap v1262: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:53:48.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:47 smithi047 ceph-mon[29365]: pgmap v1263: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:48.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:47 smithi047 ceph-mon[37680]: pgmap v1263: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:48.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:47 smithi102 ceph-mon[32821]: pgmap v1263: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:50.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:49 smithi047 ceph-mon[29365]: pgmap v1264: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:49 smithi047 ceph-mon[37680]: pgmap v1264: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:49 smithi102 ceph-mon[32821]: pgmap v1264: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:53:52.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:51 smithi047 ceph-mon[29365]: pgmap v1265: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:52.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:51 smithi047 ceph-mon[37680]: pgmap v1265: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:52.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:51 smithi102 ceph-mon[32821]: pgmap v1265: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:53.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:53:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:53:54.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:53 smithi047 ceph-mon[37680]: pgmap v1266: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:53 smithi047 ceph-mon[29365]: pgmap v1266: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:53:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:53:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:53:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:53:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:53 smithi102 ceph-mon[32821]: pgmap v1266: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:56.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:55 smithi047 ceph-mon[29365]: pgmap v1267: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:56.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:55 smithi047 ceph-mon[37680]: pgmap v1267: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:56.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:55 smithi102 ceph-mon[32821]: pgmap v1267: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:53:58.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:57 smithi047 ceph-mon[29365]: pgmap v1268: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:58.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:57 smithi047 ceph-mon[37680]: pgmap v1268: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:53:58.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:57 smithi102 ceph-mon[32821]: pgmap v1268: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:53:59 smithi047 ceph-mon[29365]: pgmap v1269: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:53:59 smithi047 ceph-mon[37680]: pgmap v1269: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:53:59 smithi102 ceph-mon[32821]: pgmap v1269: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:02.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:01 smithi047 ceph-mon[37680]: pgmap v1270: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:02.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:01 smithi047 ceph-mon[29365]: pgmap v1270: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:01 smithi102 ceph-mon[32821]: pgmap v1270: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:03.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:54:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:54:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:03 smithi047 ceph-mon[29365]: pgmap v1271: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:03 smithi047 ceph-mon[37680]: pgmap v1271: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:04.244 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:04.244 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:54:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:54:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:54:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:03 smithi102 ceph-mon[32821]: pgmap v1271: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:05.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:05.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:06.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:05 smithi047 ceph-mon[29365]: pgmap v1272: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:06.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:05 smithi047 ceph-mon[37680]: pgmap v1272: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:06.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:05 smithi102 ceph-mon[32821]: pgmap v1272: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:08.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:07 smithi047 ceph-mon[29365]: pgmap v1273: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:08.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:07 smithi047 ceph-mon[37680]: pgmap v1273: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:07 smithi102 ceph-mon[32821]: pgmap v1273: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:10.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:09 smithi047 ceph-mon[29365]: pgmap v1274: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:09 smithi047 ceph-mon[37680]: pgmap v1274: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:09 smithi102 ceph-mon[32821]: pgmap v1274: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:12.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:11 smithi047 ceph-mon[29365]: pgmap v1275: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:12.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:11 smithi047 ceph-mon[37680]: pgmap v1275: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:11 smithi102 ceph-mon[32821]: pgmap v1275: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:13.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:54:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:54:14.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:54:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:54:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:54:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:13 smithi047 ceph-mon[29365]: pgmap v1276: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:13 smithi047 ceph-mon[37680]: pgmap v1276: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:13 smithi102 ceph-mon[32821]: pgmap v1276: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T03:54:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:16.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:15 smithi047 ceph-mon[29365]: pgmap v1277: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:16.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:15 smithi047 ceph-mon[37680]: pgmap v1277: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:15 smithi102 ceph-mon[32821]: pgmap v1277: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:18.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:17 smithi047 ceph-mon[29365]: pgmap v1278: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:18.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:17 smithi047 ceph-mon[37680]: pgmap v1278: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:17 smithi102 ceph-mon[32821]: pgmap v1278: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:19 smithi047 ceph-mon[29365]: pgmap v1279: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:19 smithi047 ceph-mon[37680]: pgmap v1279: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:19 smithi102 ceph-mon[32821]: pgmap v1279: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:22.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:21 smithi047 ceph-mon[29365]: pgmap v1280: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:21 smithi047 ceph-mon[37680]: pgmap v1280: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:22.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:21 smithi102 ceph-mon[32821]: pgmap v1280: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:54:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:54:24.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:23 smithi047 ceph-mon[29365]: pgmap v1281: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:54:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:54:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:54:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:23 smithi047 ceph-mon[37680]: pgmap v1281: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:23 smithi102 ceph-mon[32821]: pgmap v1281: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:26.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:25 smithi047 ceph-mon[37680]: pgmap v1282: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:54:26.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:25 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:54:26.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:25 smithi047 ceph-mon[29365]: pgmap v1282: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:54:26.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:25 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:54:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:25 smithi102 ceph-mon[32821]: pgmap v1282: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:54:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:25 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:54:27.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:26 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:54:27.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:26 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:54:27.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:26 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:54:27.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:26 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:54:27.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:26 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:54:27.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:26 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:54:27.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:26 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:54:27.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:26 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:54:27.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:26 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:54:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:28 smithi102 ceph-mon[32821]: pgmap v1283: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:28.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:28 smithi047 ceph-mon[29365]: pgmap v1283: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:28.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:28 smithi047 ceph-mon[37680]: pgmap v1283: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:30 smithi102 ceph-mon[32821]: pgmap v1284: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:54:30.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:30 smithi047 ceph-mon[29365]: pgmap v1284: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:54:30.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:30 smithi047 ceph-mon[37680]: pgmap v1284: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:54:31.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:31 smithi047 ceph-mon[29365]: pgmap v1285: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:31.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:31 smithi047 ceph-mon[37680]: pgmap v1285: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:31.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:31 smithi102 ceph-mon[32821]: pgmap v1285: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:33.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:54:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:54:34.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:33 smithi102 ceph-mon[32821]: pgmap v1286: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:34.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:34.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:33 smithi047 ceph-mon[29365]: pgmap v1286: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:34.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:34.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:54:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:54:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:54:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:33 smithi047 ceph-mon[37680]: pgmap v1286: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:35.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:35.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:35.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:36.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:35 smithi102 ceph-mon[32821]: pgmap v1287: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:36.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:35 smithi047 ceph-mon[37680]: pgmap v1287: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:36.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:35 smithi047 ceph-mon[29365]: pgmap v1287: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:38.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:37 smithi102 ceph-mon[32821]: pgmap v1288: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:38.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:37 smithi047 ceph-mon[29365]: pgmap v1288: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:38.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:37 smithi047 ceph-mon[37680]: pgmap v1288: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:40.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:39 smithi102 ceph-mon[32821]: pgmap v1289: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:40.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:39 smithi047 ceph-mon[29365]: pgmap v1289: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:40.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:39 smithi047 ceph-mon[37680]: pgmap v1289: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:42.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:41 smithi102 ceph-mon[32821]: pgmap v1290: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:42.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:41 smithi047 ceph-mon[29365]: pgmap v1290: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:42.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:41 smithi047 ceph-mon[37680]: pgmap v1290: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:43.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:54:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:54:44.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:43 smithi102 ceph-mon[32821]: pgmap v1291: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:44.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:44.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:43 smithi047 ceph-mon[29365]: pgmap v1291: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:44.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:44.246 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:54:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:54:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:54:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:43 smithi047 ceph-mon[37680]: pgmap v1291: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:44.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:46.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:45 smithi102 ceph-mon[32821]: pgmap v1292: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:45 smithi047 ceph-mon[29365]: pgmap v1292: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:46.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:45 smithi047 ceph-mon[37680]: pgmap v1292: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:48.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:47 smithi102 ceph-mon[32821]: pgmap v1293: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:48.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:47 smithi047 ceph-mon[29365]: pgmap v1293: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:48.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:47 smithi047 ceph-mon[37680]: pgmap v1293: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:50.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:49 smithi102 ceph-mon[32821]: pgmap v1294: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:50.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:50.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:49 smithi047 ceph-mon[37680]: pgmap v1294: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:49 smithi047 ceph-mon[29365]: pgmap v1294: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:54:52.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:51 smithi102 ceph-mon[32821]: pgmap v1295: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:52.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:51 smithi047 ceph-mon[37680]: pgmap v1295: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:52.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:51 smithi047 ceph-mon[29365]: pgmap v1295: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:53.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:54:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:54:54.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:53 smithi102 ceph-mon[32821]: pgmap v1296: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:54.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:54.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:54:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:54:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:54:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:53 smithi047 ceph-mon[37680]: pgmap v1296: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:53 smithi047 ceph-mon[29365]: pgmap v1296: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:54:56.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:55 smithi102 ceph-mon[32821]: pgmap v1297: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:56.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:55 smithi047 ceph-mon[29365]: pgmap v1297: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:56.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:55 smithi047 ceph-mon[37680]: pgmap v1297: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:54:57.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:57 smithi047 ceph-mon[37680]: pgmap v1298: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:57 smithi047 ceph-mon[29365]: pgmap v1298: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:54:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:57 smithi102 ceph-mon[32821]: pgmap v1298: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:00.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:54:59 smithi102 ceph-mon[32821]: pgmap v1299: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:00.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:54:59 smithi047 ceph-mon[37680]: pgmap v1299: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:00.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:54:59 smithi047 ceph-mon[29365]: pgmap v1299: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:02.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:01 smithi102 ceph-mon[32821]: pgmap v1300: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:01 smithi047 ceph-mon[29365]: pgmap v1300: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:01 smithi047 ceph-mon[37680]: pgmap v1300: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:03.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:55:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:55:04.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:03 smithi047 ceph-mon[29365]: pgmap v1301: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:04.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:04.044 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:55:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:55:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:55:04.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:03 smithi047 ceph-mon[37680]: pgmap v1301: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:04.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:04.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:03 smithi102 ceph-mon[32821]: pgmap v1301: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:04.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:05.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:05.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:05.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:06.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:05 smithi102 ceph-mon[32821]: pgmap v1302: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:06.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:05 smithi047 ceph-mon[29365]: pgmap v1302: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:06.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:05 smithi047 ceph-mon[37680]: pgmap v1302: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:08.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:07 smithi102 ceph-mon[32821]: pgmap v1303: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:08.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:07 smithi047 ceph-mon[29365]: pgmap v1303: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:08.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:07 smithi047 ceph-mon[37680]: pgmap v1303: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:10.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:09 smithi102 ceph-mon[32821]: pgmap v1304: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:10.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:09 smithi047 ceph-mon[29365]: pgmap v1304: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:10.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:09 smithi047 ceph-mon[37680]: pgmap v1304: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:12.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:11 smithi102 ceph-mon[32821]: pgmap v1305: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:12.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:11 smithi047 ceph-mon[29365]: pgmap v1305: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:12.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:11 smithi047 ceph-mon[37680]: pgmap v1305: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:13.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:55:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:55:14.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:13 smithi102 ceph-mon[32821]: pgmap v1306: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:14.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:13 smithi047 ceph-mon[29365]: pgmap v1306: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:13 smithi047 ceph-mon[37680]: pgmap v1306: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:14.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:55:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:55:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:55:16.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:15 smithi102 ceph-mon[32821]: pgmap v1307: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:16.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:15 smithi047 ceph-mon[29365]: pgmap v1307: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:16.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:15 smithi047 ceph-mon[37680]: pgmap v1307: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:18.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:17 smithi102 ceph-mon[32821]: pgmap v1308: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:18.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:17 smithi047 ceph-mon[29365]: pgmap v1308: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:18.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:17 smithi047 ceph-mon[37680]: pgmap v1308: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:20.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:19 smithi102 ceph-mon[32821]: pgmap v1309: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:20.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:19 smithi047 ceph-mon[29365]: pgmap v1309: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:19 smithi047 ceph-mon[37680]: pgmap v1309: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:21 smithi102 ceph-mon[32821]: pgmap v1310: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:22.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:21 smithi047 ceph-mon[29365]: pgmap v1310: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:22.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:21 smithi047 ceph-mon[37680]: pgmap v1310: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:55:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:55:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:23 smithi102 ceph-mon[32821]: pgmap v1311: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:24.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:23 smithi047 ceph-mon[29365]: pgmap v1311: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:55:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:55:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:55:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:23 smithi047 ceph-mon[37680]: pgmap v1311: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:26.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:25 smithi102 ceph-mon[32821]: pgmap v1312: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:26.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:25 smithi047 ceph-mon[29365]: pgmap v1312: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:26.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:25 smithi047 ceph-mon[37680]: pgmap v1312: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:55:27.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:26 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:55:27.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:26 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:55:27.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:26 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:55:28.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:27 smithi102 ceph-mon[32821]: pgmap v1313: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:28.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:27 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:55:28.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:27 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:55:28.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:27 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:55:28.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:27 smithi047 ceph-mon[37680]: pgmap v1313: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:27 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:55:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:27 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:55:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:27 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:55:28.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:27 smithi047 ceph-mon[29365]: pgmap v1313: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:28.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:27 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:55:28.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:27 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:55:28.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:27 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:55:30.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:29 smithi102 ceph-mon[32821]: pgmap v1314: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:30.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:29 smithi047 ceph-mon[37680]: pgmap v1314: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:30.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:29 smithi047 ceph-mon[29365]: pgmap v1314: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:30.583 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 03:55:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=cleanup t=2024-04-06T03:55:30.202073955Z level=info msg="Completed cleanup jobs" duration=2.225413ms 2024-04-06T03:55:32.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:31 smithi047 ceph-mon[29365]: pgmap v1315: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:32.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:31 smithi047 ceph-mon[37680]: pgmap v1315: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:31 smithi102 ceph-mon[32821]: pgmap v1315: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:33.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:55:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:55:34.046 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:55:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:55:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:55:34.046 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:33 smithi047 ceph-mon[29365]: pgmap v1316: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:34.046 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:34.046 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:33 smithi047 ceph-mon[37680]: pgmap v1316: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:34.047 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:33 smithi102 ceph-mon[32821]: pgmap v1316: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:35.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:35.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:36.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:35 smithi047 ceph-mon[29365]: pgmap v1317: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:36.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:35 smithi047 ceph-mon[37680]: pgmap v1317: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:36.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:35 smithi102 ceph-mon[32821]: pgmap v1317: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:38.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:37 smithi047 ceph-mon[29365]: pgmap v1318: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:38.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:37 smithi047 ceph-mon[37680]: pgmap v1318: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:38.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:37 smithi102 ceph-mon[32821]: pgmap v1318: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:40.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:39 smithi047 ceph-mon[29365]: pgmap v1319: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:40.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:39 smithi047 ceph-mon[37680]: pgmap v1319: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:39 smithi102 ceph-mon[32821]: pgmap v1319: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:42.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:41 smithi047 ceph-mon[37680]: pgmap v1320: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:41 smithi047 ceph-mon[29365]: pgmap v1320: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:41 smithi102 ceph-mon[32821]: pgmap v1320: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:43.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:55:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:55:44.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:55:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:55:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:55:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:43 smithi047 ceph-mon[29365]: pgmap v1321: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:43 smithi047 ceph-mon[37680]: pgmap v1321: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:43 smithi102 ceph-mon[32821]: pgmap v1321: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:45 smithi047 ceph-mon[29365]: pgmap v1322: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:46.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:45 smithi047 ceph-mon[37680]: pgmap v1322: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:45 smithi102 ceph-mon[32821]: pgmap v1322: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:48.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:47 smithi047 ceph-mon[29365]: pgmap v1323: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:48.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:47 smithi047 ceph-mon[37680]: pgmap v1323: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:48.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:47 smithi102 ceph-mon[32821]: pgmap v1323: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:50.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:49 smithi047 ceph-mon[29365]: pgmap v1324: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:49 smithi047 ceph-mon[37680]: pgmap v1324: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:49 smithi102 ceph-mon[32821]: pgmap v1324: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:55:52.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:51 smithi047 ceph-mon[29365]: pgmap v1325: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:52.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:51 smithi047 ceph-mon[37680]: pgmap v1325: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:52.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:51 smithi102 ceph-mon[32821]: pgmap v1325: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:53.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:55:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:55:54.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:55:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:55:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:55:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:53 smithi047 ceph-mon[29365]: pgmap v1326: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:53 smithi047 ceph-mon[37680]: pgmap v1326: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:53 smithi102 ceph-mon[32821]: pgmap v1326: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:55:56.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:55 smithi047 ceph-mon[29365]: pgmap v1327: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:56.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:55 smithi047 ceph-mon[37680]: pgmap v1327: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:56.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:55 smithi102 ceph-mon[32821]: pgmap v1327: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:55:58.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:57 smithi047 ceph-mon[29365]: pgmap v1328: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:58.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:57 smithi047 ceph-mon[37680]: pgmap v1328: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:55:58.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:57 smithi102 ceph-mon[32821]: pgmap v1328: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:55:59 smithi047 ceph-mon[29365]: pgmap v1329: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:55:59 smithi047 ceph-mon[37680]: pgmap v1329: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:55:59 smithi102 ceph-mon[32821]: pgmap v1329: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:01 smithi047 ceph-mon[29365]: pgmap v1330: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:01 smithi047 ceph-mon[37680]: pgmap v1330: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:01 smithi102 ceph-mon[32821]: pgmap v1330: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:03.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:56:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:56:04.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:03 smithi047 ceph-mon[29365]: pgmap v1331: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:04.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:04.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:03 smithi047 ceph-mon[37680]: pgmap v1331: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:04.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:04.045 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:56:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:56:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:56:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:03 smithi102 ceph-mon[32821]: pgmap v1331: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:05.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:05.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:06.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:05 smithi047 ceph-mon[29365]: pgmap v1332: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:06.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:05 smithi047 ceph-mon[37680]: pgmap v1332: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:06.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:05 smithi102 ceph-mon[32821]: pgmap v1332: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:08.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:07 smithi047 ceph-mon[29365]: pgmap v1333: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:08.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:07 smithi047 ceph-mon[37680]: pgmap v1333: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:07 smithi102 ceph-mon[32821]: pgmap v1333: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:10.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:09 smithi047 ceph-mon[29365]: pgmap v1334: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:10.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:09 smithi047 ceph-mon[37680]: pgmap v1334: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:09 smithi102 ceph-mon[32821]: pgmap v1334: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:12.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:11 smithi047 ceph-mon[29365]: pgmap v1335: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:12.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:11 smithi047 ceph-mon[37680]: pgmap v1335: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:11 smithi102 ceph-mon[32821]: pgmap v1335: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:13.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:56:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:56:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:13 smithi047 ceph-mon[29365]: pgmap v1336: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:14.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:56:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:56:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:56:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:13 smithi047 ceph-mon[37680]: pgmap v1336: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:13 smithi102 ceph-mon[32821]: pgmap v1336: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:16.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:15 smithi047 ceph-mon[29365]: pgmap v1337: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:16.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:15 smithi047 ceph-mon[37680]: pgmap v1337: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:15 smithi102 ceph-mon[32821]: pgmap v1337: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:17.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:17 smithi047 ceph-mon[29365]: pgmap v1338: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:17.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:17 smithi047 ceph-mon[37680]: pgmap v1338: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:18.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:17 smithi102 ceph-mon[32821]: pgmap v1338: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:20.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:19 smithi102 ceph-mon[32821]: pgmap v1339: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:20.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:19 smithi047 ceph-mon[29365]: pgmap v1339: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:19 smithi047 ceph-mon[37680]: pgmap v1339: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:22.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:21 smithi102 ceph-mon[32821]: pgmap v1340: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:22.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:21 smithi047 ceph-mon[29365]: pgmap v1340: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:21 smithi047 ceph-mon[37680]: pgmap v1340: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:56:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:56:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:23 smithi102 ceph-mon[32821]: pgmap v1341: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:24.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:24.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:23 smithi047 ceph-mon[37680]: pgmap v1341: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:24.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:23 smithi047 ceph-mon[29365]: pgmap v1341: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:56:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:56:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:56:26.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:25 smithi102 ceph-mon[32821]: pgmap v1342: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:26.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:25 smithi047 ceph-mon[29365]: pgmap v1342: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:26.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:25 smithi047 ceph-mon[37680]: pgmap v1342: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:28.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:27 smithi102 ceph-mon[32821]: pgmap v1343: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:28.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:27 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:56:28.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:27 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:56:28.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:27 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:56:28.084 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:27 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:56:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[29365]: pgmap v1343: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:56:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:56:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:56:28.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:56:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[37680]: pgmap v1343: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:56:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:56:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:56:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:27 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:56:30.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:29 smithi102 ceph-mon[32821]: pgmap v1344: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:30.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:29 smithi047 ceph-mon[29365]: pgmap v1344: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:30.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:29 smithi047 ceph-mon[37680]: pgmap v1344: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:32.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:31 smithi102 ceph-mon[32821]: pgmap v1345: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:32.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:31 smithi047 ceph-mon[29365]: pgmap v1345: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:32.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:31 smithi047 ceph-mon[37680]: pgmap v1345: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:33.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:56:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:56:34.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:33 smithi047 ceph-mon[29365]: pgmap v1346: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:34.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:34.045 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:56:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:56:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:56:34.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:33 smithi047 ceph-mon[37680]: pgmap v1346: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:34.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:34.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:33 smithi102 ceph-mon[32821]: pgmap v1346: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:34.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:35.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:35.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:36.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:35 smithi047 ceph-mon[29365]: pgmap v1347: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:36.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:35 smithi047 ceph-mon[37680]: pgmap v1347: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:36.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:35 smithi102 ceph-mon[32821]: pgmap v1347: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:38.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:37 smithi047 ceph-mon[29365]: pgmap v1348: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:38.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:37 smithi047 ceph-mon[37680]: pgmap v1348: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:38.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:37 smithi102 ceph-mon[32821]: pgmap v1348: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:40.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:39 smithi047 ceph-mon[29365]: pgmap v1349: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:40.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:39 smithi047 ceph-mon[37680]: pgmap v1349: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:39 smithi102 ceph-mon[32821]: pgmap v1349: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:42.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:41 smithi047 ceph-mon[29365]: pgmap v1350: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:42.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:41 smithi047 ceph-mon[37680]: pgmap v1350: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:41 smithi102 ceph-mon[32821]: pgmap v1350: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:43.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:56:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:56:44.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:43 smithi047 ceph-mon[29365]: pgmap v1351: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:44.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:43 smithi047 ceph-mon[37680]: pgmap v1351: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:44.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:44.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:56:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:56:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:56:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:43 smithi102 ceph-mon[32821]: pgmap v1351: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:45 smithi047 ceph-mon[29365]: pgmap v1352: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:46.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:45 smithi047 ceph-mon[37680]: pgmap v1352: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:45 smithi102 ceph-mon[32821]: pgmap v1352: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:48.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:47 smithi047 ceph-mon[29365]: pgmap v1353: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:48.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:47 smithi047 ceph-mon[37680]: pgmap v1353: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:48.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:47 smithi102 ceph-mon[32821]: pgmap v1353: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:50.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:49 smithi047 ceph-mon[29365]: pgmap v1354: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:49 smithi047 ceph-mon[37680]: pgmap v1354: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:49 smithi102 ceph-mon[32821]: pgmap v1354: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:56:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:56:52.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:51 smithi047 ceph-mon[29365]: pgmap v1355: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:52.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:51 smithi047 ceph-mon[37680]: pgmap v1355: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:52.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:51 smithi102 ceph-mon[32821]: pgmap v1355: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:53.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:56:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:56:54.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:53 smithi047 ceph-mon[29365]: pgmap v1356: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:54.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:56:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:56:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:56:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:53 smithi047 ceph-mon[37680]: pgmap v1356: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:53 smithi102 ceph-mon[32821]: pgmap v1356: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:56:56.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:55 smithi047 ceph-mon[29365]: pgmap v1357: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:56.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:55 smithi047 ceph-mon[37680]: pgmap v1357: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:56.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:55 smithi102 ceph-mon[32821]: pgmap v1357: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:56:58.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:57 smithi047 ceph-mon[29365]: pgmap v1358: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:58.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:57 smithi047 ceph-mon[37680]: pgmap v1358: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:56:58.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:57 smithi102 ceph-mon[32821]: pgmap v1358: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:56:59 smithi047 ceph-mon[29365]: pgmap v1359: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:00.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:56:59 smithi047 ceph-mon[37680]: pgmap v1359: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:00.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:56:59 smithi102 ceph-mon[32821]: pgmap v1359: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:01 smithi047 ceph-mon[29365]: pgmap v1360: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:01 smithi047 ceph-mon[37680]: pgmap v1360: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:01 smithi102 ceph-mon[32821]: pgmap v1360: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:03.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:57:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:57:04.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:03 smithi047 ceph-mon[29365]: pgmap v1361: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:04.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:04.045 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:57:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:57:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:57:04.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:03 smithi047 ceph-mon[37680]: pgmap v1361: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:04.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:03 smithi102 ceph-mon[32821]: pgmap v1361: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:05.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:05.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:06.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:05 smithi047 ceph-mon[29365]: pgmap v1362: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:06.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:05 smithi047 ceph-mon[37680]: pgmap v1362: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:06.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:05 smithi102 ceph-mon[32821]: pgmap v1362: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:08.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:07 smithi047 ceph-mon[29365]: pgmap v1363: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:08.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:07 smithi047 ceph-mon[37680]: pgmap v1363: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:07 smithi102 ceph-mon[32821]: pgmap v1363: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:10.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:09 smithi047 ceph-mon[29365]: pgmap v1364: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:10.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:09 smithi047 ceph-mon[37680]: pgmap v1364: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:09 smithi102 ceph-mon[32821]: pgmap v1364: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:12.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:11 smithi047 ceph-mon[29365]: pgmap v1365: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:12.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:11 smithi047 ceph-mon[37680]: pgmap v1365: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:11 smithi102 ceph-mon[32821]: pgmap v1365: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:13.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:57:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:57:14.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:57:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:57:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:57:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:13 smithi047 ceph-mon[29365]: pgmap v1366: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:14.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:13 smithi047 ceph-mon[37680]: pgmap v1366: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:13 smithi102 ceph-mon[32821]: pgmap v1366: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:16.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:15 smithi047 ceph-mon[29365]: pgmap v1367: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:16.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:15 smithi047 ceph-mon[37680]: pgmap v1367: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:15 smithi102 ceph-mon[32821]: pgmap v1367: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:18.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:17 smithi047 ceph-mon[29365]: pgmap v1368: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:18.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:17 smithi047 ceph-mon[37680]: pgmap v1368: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:17 smithi102 ceph-mon[32821]: pgmap v1368: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:19 smithi047 ceph-mon[29365]: pgmap v1369: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:20.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:19 smithi047 ceph-mon[37680]: pgmap v1369: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:19 smithi102 ceph-mon[32821]: pgmap v1369: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:22.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:21 smithi047 ceph-mon[29365]: pgmap v1370: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:22.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:21 smithi047 ceph-mon[37680]: pgmap v1370: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:22.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:21 smithi102 ceph-mon[32821]: pgmap v1370: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:23.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:57:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:57:24.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:57:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:57:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:57:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:23 smithi047 ceph-mon[37680]: pgmap v1371: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:23 smithi047 ceph-mon[29365]: pgmap v1371: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:23 smithi102 ceph-mon[32821]: pgmap v1371: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:26.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:25 smithi047 ceph-mon[29365]: pgmap v1372: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:26.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:25 smithi047 ceph-mon[37680]: pgmap v1372: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:25 smithi102 ceph-mon[32821]: pgmap v1372: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:57:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:27 smithi047 ceph-mon[29365]: pgmap v1373: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:27 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:57:28.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:27 smithi047 ceph-mon[37680]: pgmap v1373: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:28.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:27 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:57:28.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:27 smithi102 ceph-mon[32821]: pgmap v1373: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:28.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:27 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:57:30.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:29 smithi047 ceph-mon[29365]: pgmap v1374: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:30.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:29 smithi047 ceph-mon[37680]: pgmap v1374: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:30.296 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:29 smithi102 ceph-mon[32821]: pgmap v1374: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:32.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:31 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:32.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:31 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:32.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:31 smithi102 ceph-mon[32821]: pgmap v1375: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:32.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:31 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:32.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:31 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:32.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:31 smithi047 ceph-mon[29365]: pgmap v1375: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:32.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:31 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:32.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:31 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:32.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:31 smithi047 ceph-mon[37680]: pgmap v1375: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:33.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:57:33.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:57:33.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:57:33.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:57:33.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:32 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:32 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:32 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:32 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:57:33.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:32 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:57:33.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:32 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:57:33.334 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:57:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:57:34.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:33 smithi047 ceph-mon[29365]: pgmap v1376: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:34.144 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:34.144 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:57:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:57:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:57:34.144 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:33 smithi047 ceph-mon[37680]: pgmap v1376: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:34.144 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:34.234 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:33 smithi102 ceph-mon[32821]: pgmap v1376: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:34.234 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:35.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:35.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:35.250 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:36.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:35 smithi047 ceph-mon[29365]: pgmap v1377: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:36.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:35 smithi047 ceph-mon[37680]: pgmap v1377: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:36.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:35 smithi102 ceph-mon[32821]: pgmap v1377: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:38.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:37 smithi047 ceph-mon[29365]: pgmap v1378: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:38.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:37 smithi047 ceph-mon[37680]: pgmap v1378: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:38.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:37 smithi102 ceph-mon[32821]: pgmap v1378: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:40.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:39 smithi047 ceph-mon[29365]: pgmap v1379: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:40.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:39 smithi047 ceph-mon[37680]: pgmap v1379: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:39 smithi102 ceph-mon[32821]: pgmap v1379: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:42.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:41 smithi047 ceph-mon[29365]: pgmap v1380: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:42.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:41 smithi047 ceph-mon[37680]: pgmap v1380: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:41 smithi102 ceph-mon[32821]: pgmap v1380: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:43.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:57:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:57:44.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:43 smithi047 ceph-mon[37680]: pgmap v1381: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:44.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:43 smithi047 ceph-mon[29365]: pgmap v1381: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:44.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:57:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:57:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:57:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:43 smithi102 ceph-mon[32821]: pgmap v1381: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:45 smithi047 ceph-mon[29365]: pgmap v1382: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:46.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:45 smithi047 ceph-mon[37680]: pgmap v1382: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:45 smithi102 ceph-mon[32821]: pgmap v1382: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:48.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:47 smithi047 ceph-mon[29365]: pgmap v1383: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:48.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:47 smithi047 ceph-mon[37680]: pgmap v1383: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:48.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:47 smithi102 ceph-mon[32821]: pgmap v1383: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:50.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:49 smithi047 ceph-mon[29365]: pgmap v1384: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:50.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:49 smithi047 ceph-mon[37680]: pgmap v1384: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:50.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:49 smithi102 ceph-mon[32821]: pgmap v1384: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:57:52.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:51 smithi047 ceph-mon[29365]: pgmap v1385: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:52.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:51 smithi047 ceph-mon[37680]: pgmap v1385: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:52.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:51 smithi102 ceph-mon[32821]: pgmap v1385: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:53.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:57:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:57:54.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:53 smithi047 ceph-mon[29365]: pgmap v1386: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:54.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:53 smithi047 ceph-mon[37680]: pgmap v1386: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:57:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:57:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:57:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:53 smithi102 ceph-mon[32821]: pgmap v1386: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:57:56.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:55 smithi047 ceph-mon[29365]: pgmap v1387: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:56.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:55 smithi047 ceph-mon[37680]: pgmap v1387: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:56.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:55 smithi102 ceph-mon[32821]: pgmap v1387: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:57:58.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:57 smithi047 ceph-mon[29365]: pgmap v1388: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:58.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:57 smithi047 ceph-mon[37680]: pgmap v1388: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:57:58.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:57 smithi102 ceph-mon[32821]: pgmap v1388: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:57:59 smithi102 ceph-mon[32821]: pgmap v1389: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:00.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:57:59 smithi047 ceph-mon[29365]: pgmap v1389: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:00.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:57:59 smithi047 ceph-mon[37680]: pgmap v1389: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:01 smithi102 ceph-mon[32821]: pgmap v1390: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:02.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:01 smithi047 ceph-mon[29365]: pgmap v1390: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:02.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:01 smithi047 ceph-mon[37680]: pgmap v1390: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:03.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:58:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:58:04.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:04 smithi047 ceph-mon[29365]: pgmap v1391: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:04.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:04.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:04 smithi047 ceph-mon[37680]: pgmap v1391: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:04.246 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:04.246 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:58:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:58:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:58:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:04 smithi102 ceph-mon[32821]: pgmap v1391: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:05.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:06.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:06 smithi102 ceph-mon[32821]: pgmap v1392: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:06.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:06 smithi047 ceph-mon[29365]: pgmap v1392: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:06.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:06 smithi047 ceph-mon[37680]: pgmap v1392: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:08 smithi102 ceph-mon[32821]: pgmap v1393: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:08 smithi047 ceph-mon[29365]: pgmap v1393: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:08 smithi047 ceph-mon[37680]: pgmap v1393: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:10 smithi102 ceph-mon[32821]: pgmap v1394: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:10 smithi047 ceph-mon[29365]: pgmap v1394: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:10 smithi047 ceph-mon[37680]: pgmap v1394: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:12 smithi102 ceph-mon[32821]: pgmap v1395: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:12 smithi047 ceph-mon[29365]: pgmap v1395: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:12 smithi047 ceph-mon[37680]: pgmap v1395: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:13.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:58:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:58:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:14 smithi047 ceph-mon[29365]: pgmap v1396: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:14.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:58:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:58:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:58:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:14 smithi047 ceph-mon[37680]: pgmap v1396: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:14 smithi102 ceph-mon[32821]: pgmap v1396: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:16 smithi102 ceph-mon[32821]: pgmap v1397: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:16 smithi047 ceph-mon[29365]: pgmap v1397: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:16.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:16 smithi047 ceph-mon[37680]: pgmap v1397: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:18 smithi102 ceph-mon[32821]: pgmap v1398: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:18 smithi047 ceph-mon[29365]: pgmap v1398: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:18 smithi047 ceph-mon[37680]: pgmap v1398: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:20 smithi102 ceph-mon[32821]: pgmap v1399: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:20 smithi047 ceph-mon[37680]: pgmap v1399: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:20.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:20 smithi047 ceph-mon[29365]: pgmap v1399: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:20.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:22.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:22 smithi102 ceph-mon[32821]: pgmap v1400: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:22 smithi047 ceph-mon[29365]: pgmap v1400: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:22.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:22 smithi047 ceph-mon[37680]: pgmap v1400: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:23.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:58:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:58:24.031 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:58:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:58:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:58:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:24 smithi102 ceph-mon[32821]: pgmap v1401: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:24.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:24 smithi047 ceph-mon[29365]: pgmap v1401: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:24.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:24 smithi047 ceph-mon[37680]: pgmap v1401: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:26 smithi102 ceph-mon[32821]: pgmap v1402: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:26 smithi047 ceph-mon[29365]: pgmap v1402: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:26.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:26 smithi047 ceph-mon[37680]: pgmap v1402: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:28.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:28 smithi102 ceph-mon[32821]: pgmap v1403: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:28 smithi047 ceph-mon[29365]: pgmap v1403: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:28 smithi047 ceph-mon[37680]: pgmap v1403: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:30 smithi102 ceph-mon[32821]: pgmap v1404: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:30 smithi047 ceph-mon[29365]: pgmap v1404: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:30 smithi047 ceph-mon[37680]: pgmap v1404: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:32 smithi102 ceph-mon[32821]: pgmap v1405: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:32 smithi047 ceph-mon[29365]: pgmap v1405: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:32.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:32 smithi047 ceph-mon[37680]: pgmap v1405: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:33.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:33 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:58:33.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:58:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:58:33.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:33 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:58:33.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:33 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:58:34.049 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:58:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:58:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:58:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:34 smithi102 ceph-mon[32821]: pgmap v1406: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:58:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:58:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:58:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[29365]: pgmap v1406: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:58:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:58:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:58:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[37680]: pgmap v1406: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:58:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:58:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:58:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:36.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:36 smithi102 ceph-mon[32821]: pgmap v1407: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:36 smithi047 ceph-mon[29365]: pgmap v1407: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:36.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:36 smithi047 ceph-mon[37680]: pgmap v1407: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:38.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:38 smithi102 ceph-mon[32821]: pgmap v1408: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:38 smithi047 ceph-mon[29365]: pgmap v1408: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:38 smithi047 ceph-mon[37680]: pgmap v1408: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:40 smithi102 ceph-mon[32821]: pgmap v1409: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:40 smithi047 ceph-mon[29365]: pgmap v1409: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:40.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:40 smithi047 ceph-mon[37680]: pgmap v1409: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:42 smithi102 ceph-mon[32821]: pgmap v1410: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:42 smithi047 ceph-mon[29365]: pgmap v1410: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:42 smithi047 ceph-mon[37680]: pgmap v1410: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:43.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:58:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:58:44.067 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:58:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:58:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:58:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:44 smithi102 ceph-mon[32821]: pgmap v1411: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:44 smithi047 ceph-mon[29365]: pgmap v1411: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:44 smithi047 ceph-mon[37680]: pgmap v1411: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:44.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:46 smithi102 ceph-mon[32821]: pgmap v1412: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:46 smithi047 ceph-mon[29365]: pgmap v1412: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:46 smithi047 ceph-mon[37680]: pgmap v1412: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:48.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:48 smithi102 ceph-mon[32821]: pgmap v1413: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:48 smithi047 ceph-mon[29365]: pgmap v1413: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:48 smithi047 ceph-mon[37680]: pgmap v1413: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:50 smithi102 ceph-mon[32821]: pgmap v1414: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:50.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:50 smithi047 ceph-mon[37680]: pgmap v1414: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:50.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:50 smithi047 ceph-mon[29365]: pgmap v1414: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:50.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:58:52.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:52 smithi102 ceph-mon[32821]: pgmap v1415: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:52 smithi047 ceph-mon[29365]: pgmap v1415: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:52.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:52 smithi047 ceph-mon[37680]: pgmap v1415: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:58:53.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:58:52 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:58:54.081 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:58:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:58:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:58:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:54 smithi102 ceph-mon[32821]: pgmap v1416: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:54 smithi047 ceph-mon[29365]: pgmap v1416: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:54 smithi047 ceph-mon[37680]: pgmap v1416: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:58:56.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:56 smithi047 ceph-mon[29365]: pgmap v1417: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:56.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:56 smithi047 ceph-mon[37680]: pgmap v1417: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:56.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:56 smithi102 ceph-mon[32821]: pgmap v1417: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:58:58.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:58:58 smithi047 ceph-mon[29365]: pgmap v1418: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:58.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:58:58 smithi047 ceph-mon[37680]: pgmap v1418: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:58:58.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:58:58 smithi102 ceph-mon[32821]: pgmap v1418: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:00.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:00 smithi047 ceph-mon[29365]: pgmap v1419: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:00.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:00 smithi047 ceph-mon[37680]: pgmap v1419: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:00 smithi102 ceph-mon[32821]: pgmap v1419: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:02.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:02 smithi047 ceph-mon[29365]: pgmap v1420: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:02.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:02 smithi047 ceph-mon[37680]: pgmap v1420: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:02.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:02 smithi102 ceph-mon[32821]: pgmap v1420: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:03.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:59:02 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:59:04.095 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:59:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:59:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:59:04.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:04 smithi047 ceph-mon[37680]: pgmap v1421: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:04.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:04 smithi047 ceph-mon[29365]: pgmap v1421: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:04.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:04 smithi102 ceph-mon[32821]: pgmap v1421: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:05.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:06.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:06 smithi047 ceph-mon[29365]: pgmap v1422: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:06 smithi047 ceph-mon[37680]: pgmap v1422: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:06 smithi102 ceph-mon[32821]: pgmap v1422: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:08 smithi047 ceph-mon[29365]: pgmap v1423: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:08 smithi047 ceph-mon[37680]: pgmap v1423: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:08.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:08 smithi102 ceph-mon[32821]: pgmap v1423: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:10 smithi047 ceph-mon[29365]: pgmap v1424: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:10 smithi047 ceph-mon[37680]: pgmap v1424: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:10 smithi102 ceph-mon[32821]: pgmap v1424: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:12 smithi047 ceph-mon[29365]: pgmap v1425: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:12 smithi047 ceph-mon[37680]: pgmap v1425: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:12.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:12 smithi102 ceph-mon[32821]: pgmap v1425: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:13.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:59:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:59:14.112 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:59:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:59:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:59:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:14 smithi047 ceph-mon[29365]: pgmap v1426: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:14 smithi047 ceph-mon[37680]: pgmap v1426: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:14.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:14 smithi102 ceph-mon[32821]: pgmap v1426: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:16 smithi047 ceph-mon[29365]: pgmap v1427: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:16.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:16 smithi047 ceph-mon[37680]: pgmap v1427: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:16.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:16 smithi102 ceph-mon[32821]: pgmap v1427: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:18 smithi047 ceph-mon[29365]: pgmap v1428: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:18 smithi047 ceph-mon[37680]: pgmap v1428: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:18.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:18 smithi102 ceph-mon[32821]: pgmap v1428: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:20 smithi047 ceph-mon[29365]: pgmap v1429: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:20 smithi047 ceph-mon[37680]: pgmap v1429: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:20.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:20 smithi102 ceph-mon[32821]: pgmap v1429: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:22 smithi047 ceph-mon[29365]: pgmap v1430: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:22.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:22 smithi047 ceph-mon[37680]: pgmap v1430: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:22 smithi102 ceph-mon[32821]: pgmap v1430: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:23.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:59:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:59:24.126 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:59:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:59:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:59:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:24 smithi047 ceph-mon[29365]: pgmap v1431: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:24.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:24 smithi047 ceph-mon[37680]: pgmap v1431: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:24 smithi102 ceph-mon[32821]: pgmap v1431: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:26 smithi047 ceph-mon[29365]: pgmap v1432: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:26.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:26 smithi047 ceph-mon[37680]: pgmap v1432: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:26 smithi102 ceph-mon[32821]: pgmap v1432: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:28 smithi047 ceph-mon[29365]: pgmap v1433: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:28 smithi047 ceph-mon[37680]: pgmap v1433: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:28 smithi102 ceph-mon[32821]: pgmap v1433: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:30 smithi047 ceph-mon[29365]: pgmap v1434: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:30 smithi047 ceph-mon[37680]: pgmap v1434: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:30 smithi102 ceph-mon[32821]: pgmap v1434: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:32 smithi047 ceph-mon[29365]: pgmap v1435: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:32.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:32 smithi047 ceph-mon[37680]: pgmap v1435: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:32.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:32 smithi102 ceph-mon[32821]: pgmap v1435: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:33.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:59:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:59:34.140 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:59:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:59:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:59:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[37680]: pgmap v1436: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:59:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[29365]: pgmap v1436: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:59:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:34.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:34 smithi102 ceph-mon[32821]: pgmap v1436: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T03:59:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:59:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:59:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:35.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:35.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:59:35.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:59:35.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T03:59:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T03:59:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T03:59:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:36 smithi047 ceph-mon[29365]: pgmap v1437: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:36 smithi047 ceph-mon[37680]: pgmap v1437: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:36.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:36 smithi102 ceph-mon[32821]: pgmap v1437: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:38 smithi047 ceph-mon[29365]: pgmap v1438: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:38 smithi047 ceph-mon[37680]: pgmap v1438: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:38 smithi102 ceph-mon[32821]: pgmap v1438: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:40 smithi047 ceph-mon[29365]: pgmap v1439: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:40.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:40 smithi047 ceph-mon[37680]: pgmap v1439: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:40.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:40 smithi102 ceph-mon[32821]: pgmap v1439: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:42 smithi047 ceph-mon[29365]: pgmap v1440: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:42 smithi047 ceph-mon[37680]: pgmap v1440: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:42 smithi102 ceph-mon[32821]: pgmap v1440: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:43.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:59:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:59:44.155 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:59:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:59:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:59:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:44 smithi047 ceph-mon[29365]: pgmap v1441: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:44.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:44 smithi047 ceph-mon[37680]: pgmap v1441: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:44.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:44 smithi102 ceph-mon[32821]: pgmap v1441: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:46 smithi047 ceph-mon[29365]: pgmap v1442: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:46.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:46 smithi047 ceph-mon[37680]: pgmap v1442: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:46 smithi102 ceph-mon[32821]: pgmap v1442: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:48 smithi047 ceph-mon[37680]: pgmap v1443: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:48 smithi047 ceph-mon[29365]: pgmap v1443: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:48 smithi102 ceph-mon[32821]: pgmap v1443: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:50 smithi047 ceph-mon[29365]: pgmap v1444: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:50 smithi047 ceph-mon[37680]: pgmap v1444: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:50 smithi102 ceph-mon[32821]: pgmap v1444: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T03:59:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:52 smithi047 ceph-mon[29365]: pgmap v1445: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:52.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:52 smithi047 ceph-mon[37680]: pgmap v1445: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:52 smithi102 ceph-mon[32821]: pgmap v1445: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T03:59:53.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 03:59:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T03:59:54.169 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 03:59:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:03:59:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T03:59:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:54 smithi047 ceph-mon[29365]: pgmap v1446: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:54.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:54 smithi047 ceph-mon[37680]: pgmap v1446: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:54.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:54 smithi102 ceph-mon[32821]: pgmap v1446: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T03:59:56.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:56 smithi047 ceph-mon[29365]: pgmap v1447: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:56.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:56 smithi047 ceph-mon[37680]: pgmap v1447: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:56.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:56 smithi102 ceph-mon[32821]: pgmap v1447: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T03:59:58.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 03:59:58 smithi047 ceph-mon[29365]: pgmap v1448: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:58.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 03:59:58 smithi047 ceph-mon[37680]: pgmap v1448: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T03:59:58.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 03:59:58 smithi102 ceph-mon[32821]: pgmap v1448: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:00.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[37680]: pgmap v1449: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:00.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[37680]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-04-06T04:00:00.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[37680]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[37680]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[37680]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[37680]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[29365]: pgmap v1449: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[29365]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[29365]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[29365]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[29365]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T04:00:00.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:00 smithi047 ceph-mon[29365]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T04:00:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:00 smithi102 ceph-mon[32821]: pgmap v1449: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:00 smithi102 ceph-mon[32821]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-04-06T04:00:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:00 smithi102 ceph-mon[32821]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-04-06T04:00:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:00 smithi102 ceph-mon[32821]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-06T04:00:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:00 smithi102 ceph-mon[32821]: application not enabled on pool 'ceph_test_rados_list_parallel.smithi047-75223' 2024-04-06T04:00:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:00 smithi102 ceph-mon[32821]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-06T04:00:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:02 smithi047 ceph-mon[29365]: pgmap v1450: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:02 smithi047 ceph-mon[37680]: pgmap v1450: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:02.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:02 smithi102 ceph-mon[32821]: pgmap v1450: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:03.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:00:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:00:04.045 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:00:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:00:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:00:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:04 smithi047 ceph-mon[29365]: pgmap v1451: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:04.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:04 smithi047 ceph-mon[37680]: pgmap v1451: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:04.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:04 smithi102 ceph-mon[32821]: pgmap v1451: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:05.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:06.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:06 smithi047 ceph-mon[29365]: pgmap v1452: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:06 smithi047 ceph-mon[37680]: pgmap v1452: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:06 smithi102 ceph-mon[32821]: pgmap v1452: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:08 smithi047 ceph-mon[29365]: pgmap v1453: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:08 smithi047 ceph-mon[37680]: pgmap v1453: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:08.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:08 smithi102 ceph-mon[32821]: pgmap v1453: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:10 smithi047 ceph-mon[29365]: pgmap v1454: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:10 smithi047 ceph-mon[37680]: pgmap v1454: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:10 smithi102 ceph-mon[32821]: pgmap v1454: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:12 smithi047 ceph-mon[29365]: pgmap v1455: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:12 smithi047 ceph-mon[37680]: pgmap v1455: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:12.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:12 smithi102 ceph-mon[32821]: pgmap v1455: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:13.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:00:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:00:14.204 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:00:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:00:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:00:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:14 smithi047 ceph-mon[29365]: pgmap v1456: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:14 smithi047 ceph-mon[37680]: pgmap v1456: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:14.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:14 smithi102 ceph-mon[32821]: pgmap v1456: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:16 smithi047 ceph-mon[29365]: pgmap v1457: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:16.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:16 smithi047 ceph-mon[37680]: pgmap v1457: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:16.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:16 smithi102 ceph-mon[32821]: pgmap v1457: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:17.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:17 smithi047 ceph-mon[29365]: pgmap v1458: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:17.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:17 smithi047 ceph-mon[37680]: pgmap v1458: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:18.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:17 smithi102 ceph-mon[32821]: pgmap v1458: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:19 smithi047 ceph-mon[37680]: pgmap v1459: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:19 smithi047 ceph-mon[29365]: pgmap v1459: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:20.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:19 smithi102 ceph-mon[32821]: pgmap v1459: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:22.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:21 smithi047 ceph-mon[37680]: pgmap v1460: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:22.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:21 smithi047 ceph-mon[29365]: pgmap v1460: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:22.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:21 smithi102 ceph-mon[32821]: pgmap v1460: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:23.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:00:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:00:24.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:00:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:00:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:00:24.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:23 smithi047 ceph-mon[37680]: pgmap v1461: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:24.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:23 smithi047 ceph-mon[29365]: pgmap v1461: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:24.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:23 smithi102 ceph-mon[32821]: pgmap v1461: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:26.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:25 smithi047 ceph-mon[29365]: pgmap v1462: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:26.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:25 smithi047 ceph-mon[37680]: pgmap v1462: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:25 smithi102 ceph-mon[32821]: pgmap v1462: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:27 smithi047 ceph-mon[29365]: pgmap v1463: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:28.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:27 smithi047 ceph-mon[37680]: pgmap v1463: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:28.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:27 smithi102 ceph-mon[32821]: pgmap v1463: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:30.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:29 smithi047 ceph-mon[29365]: pgmap v1464: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:30.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:29 smithi047 ceph-mon[37680]: pgmap v1464: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:29 smithi102 ceph-mon[32821]: pgmap v1464: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:32.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:31 smithi047 ceph-mon[29365]: pgmap v1465: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:32.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:31 smithi047 ceph-mon[37680]: pgmap v1465: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:31 smithi102 ceph-mon[32821]: pgmap v1465: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:33.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:00:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:00:34.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:33 smithi047 ceph-mon[29365]: pgmap v1466: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:34.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:34.045 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:00:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:00:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:00:34.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:33 smithi047 ceph-mon[37680]: pgmap v1466: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:34.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:34.234 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:33 smithi102 ceph-mon[32821]: pgmap v1466: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:34.234 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:35.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:35.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:00:35.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:35.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:00:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:00:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[29365]: pgmap v1467: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[37680]: pgmap v1467: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:00:36.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:36 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:36 smithi102 ceph-mon[32821]: pgmap v1467: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:36 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:36 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:36 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:00:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:36 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:00:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:36 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:00:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:38 smithi047 ceph-mon[29365]: pgmap v1468: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:38 smithi047 ceph-mon[37680]: pgmap v1468: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:38 smithi102 ceph-mon[32821]: pgmap v1468: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:40 smithi047 ceph-mon[29365]: pgmap v1469: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:40.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:40 smithi047 ceph-mon[37680]: pgmap v1469: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:40.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:40 smithi102 ceph-mon[32821]: pgmap v1469: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:42 smithi047 ceph-mon[29365]: pgmap v1470: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:42 smithi047 ceph-mon[37680]: pgmap v1470: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:42 smithi102 ceph-mon[32821]: pgmap v1470: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:43.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:00:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:00:44.155 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:00:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:00:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:00:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:44 smithi047 ceph-mon[29365]: pgmap v1471: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:44 smithi047 ceph-mon[37680]: pgmap v1471: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:44 smithi102 ceph-mon[32821]: pgmap v1471: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:46 smithi047 ceph-mon[29365]: pgmap v1472: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:46 smithi047 ceph-mon[37680]: pgmap v1472: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:46 smithi102 ceph-mon[32821]: pgmap v1472: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:48 smithi047 ceph-mon[29365]: pgmap v1473: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:48 smithi047 ceph-mon[37680]: pgmap v1473: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:48 smithi102 ceph-mon[32821]: pgmap v1473: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:50 smithi047 ceph-mon[29365]: pgmap v1474: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:50.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:50 smithi047 ceph-mon[37680]: pgmap v1474: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:50 smithi102 ceph-mon[32821]: pgmap v1474: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:00:52.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:52 smithi047 ceph-mon[37680]: pgmap v1475: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:52.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:52 smithi047 ceph-mon[29365]: pgmap v1475: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:52 smithi102 ceph-mon[32821]: pgmap v1475: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:00:53.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:00:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:00:54.170 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:00:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:00:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:00:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:54 smithi047 ceph-mon[29365]: pgmap v1476: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:54.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:54 smithi047 ceph-mon[37680]: pgmap v1476: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:54.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:54 smithi102 ceph-mon[32821]: pgmap v1476: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:00:56.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:56 smithi047 ceph-mon[29365]: pgmap v1477: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:56.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:56 smithi047 ceph-mon[37680]: pgmap v1477: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:56.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:56 smithi102 ceph-mon[32821]: pgmap v1477: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:00:58.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:00:58 smithi047 ceph-mon[29365]: pgmap v1478: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:58.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:00:58 smithi047 ceph-mon[37680]: pgmap v1478: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:00:58.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:00:58 smithi102 ceph-mon[32821]: pgmap v1478: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:00.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:00 smithi047 ceph-mon[29365]: pgmap v1479: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:00.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:00 smithi047 ceph-mon[37680]: pgmap v1479: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:00 smithi102 ceph-mon[32821]: pgmap v1479: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:02.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:02 smithi047 ceph-mon[37680]: pgmap v1480: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:02.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:02 smithi047 ceph-mon[29365]: pgmap v1480: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:02.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:02 smithi102 ceph-mon[32821]: pgmap v1480: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:03.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:01:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:01:04.184 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:01:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:01:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:01:04.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:04 smithi047 ceph-mon[29365]: pgmap v1481: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:04.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:04.476 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:04 smithi047 ceph-mon[37680]: pgmap v1481: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:04.476 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:04 smithi102 ceph-mon[32821]: pgmap v1481: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:05.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:05.445 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:05.497 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:06.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:06 smithi047 ceph-mon[29365]: pgmap v1482: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:06 smithi047 ceph-mon[37680]: pgmap v1482: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:06 smithi102 ceph-mon[32821]: pgmap v1482: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:08 smithi047 ceph-mon[29365]: pgmap v1483: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:08 smithi047 ceph-mon[37680]: pgmap v1483: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:08.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:08 smithi102 ceph-mon[32821]: pgmap v1483: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:10 smithi047 ceph-mon[29365]: pgmap v1484: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:10 smithi047 ceph-mon[37680]: pgmap v1484: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:10 smithi102 ceph-mon[32821]: pgmap v1484: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:12 smithi047 ceph-mon[29365]: pgmap v1485: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:12 smithi047 ceph-mon[37680]: pgmap v1485: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:12.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:12 smithi102 ceph-mon[32821]: pgmap v1485: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:13.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:01:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:01:14.202 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:01:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:01:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:01:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:14 smithi047 ceph-mon[29365]: pgmap v1486: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:14 smithi047 ceph-mon[37680]: pgmap v1486: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:14 smithi102 ceph-mon[32821]: pgmap v1486: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:16.487 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:16 smithi102 ceph-mon[32821]: pgmap v1487: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:16 smithi047 ceph-mon[29365]: pgmap v1487: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:16.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:16 smithi047 ceph-mon[37680]: pgmap v1487: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:18 smithi047 ceph-mon[29365]: pgmap v1488: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:18 smithi047 ceph-mon[37680]: pgmap v1488: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:18.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:18 smithi102 ceph-mon[32821]: pgmap v1488: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:20 smithi047 ceph-mon[29365]: pgmap v1489: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:20 smithi047 ceph-mon[37680]: pgmap v1489: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:20.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:20 smithi102 ceph-mon[32821]: pgmap v1489: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:22 smithi047 ceph-mon[29365]: pgmap v1490: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:22.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:22 smithi047 ceph-mon[37680]: pgmap v1490: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:22 smithi102 ceph-mon[32821]: pgmap v1490: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:23.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:01:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:01:24.216 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:01:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:01:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:01:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:24 smithi047 ceph-mon[29365]: pgmap v1491: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:24.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:24 smithi047 ceph-mon[37680]: pgmap v1491: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:24.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:24 smithi102 ceph-mon[32821]: pgmap v1491: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:26.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:26 smithi047 ceph-mon[37680]: pgmap v1492: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:26 smithi047 ceph-mon[29365]: pgmap v1492: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:26 smithi102 ceph-mon[32821]: pgmap v1492: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:28 smithi047 ceph-mon[29365]: pgmap v1493: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:28 smithi047 ceph-mon[37680]: pgmap v1493: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:28 smithi102 ceph-mon[32821]: pgmap v1493: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:30 smithi047 ceph-mon[29365]: pgmap v1494: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:30 smithi047 ceph-mon[37680]: pgmap v1494: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:30 smithi102 ceph-mon[32821]: pgmap v1494: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:32 smithi047 ceph-mon[29365]: pgmap v1495: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:32.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:32 smithi047 ceph-mon[37680]: pgmap v1495: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:32.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:32 smithi102 ceph-mon[32821]: pgmap v1495: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:33.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:01:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:01:34.230 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:01:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:01:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:01:34.484 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:34 smithi102 ceph-mon[32821]: pgmap v1496: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:34.484 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:34.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:34 smithi047 ceph-mon[29365]: pgmap v1496: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:34.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:34 smithi047 ceph-mon[37680]: pgmap v1496: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:34.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:36 smithi047 ceph-mon[29365]: pgmap v1497: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:36 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:01:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:36 smithi047 ceph-mon[37680]: pgmap v1497: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:36 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:01:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:36 smithi102 ceph-mon[32821]: pgmap v1497: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:36 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:01:37.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:37 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:01:37.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:37 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:01:37.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:37 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:01:37.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:37 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:01:37.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:37 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:01:37.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:37 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:01:37.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:37 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:01:37.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:37 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:01:37.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:37 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:01:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:38 smithi047 ceph-mon[29365]: pgmap v1498: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:38 smithi047 ceph-mon[37680]: pgmap v1498: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:38 smithi102 ceph-mon[32821]: pgmap v1498: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:40.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:40 smithi102 ceph-mon[32821]: pgmap v1499: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:40.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:40 smithi047 ceph-mon[29365]: pgmap v1499: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:40.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:40 smithi047 ceph-mon[37680]: pgmap v1499: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:42 smithi102 ceph-mon[32821]: pgmap v1500: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:42.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:42 smithi047 ceph-mon[29365]: pgmap v1500: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:42.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:42 smithi047 ceph-mon[37680]: pgmap v1500: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:43.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:01:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:01:44.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:01:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:01:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:01:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:44 smithi102 ceph-mon[32821]: pgmap v1501: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:44.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:44 smithi047 ceph-mon[29365]: pgmap v1501: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:44.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:44.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:44 smithi047 ceph-mon[37680]: pgmap v1501: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:44.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:46 smithi102 ceph-mon[32821]: pgmap v1502: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:46.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:46 smithi047 ceph-mon[29365]: pgmap v1502: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:46.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:46 smithi047 ceph-mon[37680]: pgmap v1502: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:48 smithi102 ceph-mon[32821]: pgmap v1503: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:48.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:48 smithi047 ceph-mon[29365]: pgmap v1503: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:48.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:48 smithi047 ceph-mon[37680]: pgmap v1503: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:50 smithi102 ceph-mon[32821]: pgmap v1504: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:50.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:50 smithi047 ceph-mon[29365]: pgmap v1504: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:50.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:50.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:50 smithi047 ceph-mon[37680]: pgmap v1504: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:50.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:01:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:52 smithi102 ceph-mon[32821]: pgmap v1505: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:52.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:52 smithi047 ceph-mon[29365]: pgmap v1505: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:52.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:52 smithi047 ceph-mon[37680]: pgmap v1505: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:01:53.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:01:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:01:54.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:01:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:01:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:01:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:54 smithi102 ceph-mon[32821]: pgmap v1506: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:54.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:54 smithi047 ceph-mon[29365]: pgmap v1506: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:54.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:54.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:54 smithi047 ceph-mon[37680]: pgmap v1506: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:54.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:01:56.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:56 smithi102 ceph-mon[32821]: pgmap v1507: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:56.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:56 smithi047 ceph-mon[29365]: pgmap v1507: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:56.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:56 smithi047 ceph-mon[37680]: pgmap v1507: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:01:58.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:01:58 smithi102 ceph-mon[32821]: pgmap v1508: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:58.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:01:58 smithi047 ceph-mon[29365]: pgmap v1508: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:01:58.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:01:58 smithi047 ceph-mon[37680]: pgmap v1508: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:00 smithi102 ceph-mon[32821]: pgmap v1509: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:00.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:00 smithi047 ceph-mon[29365]: pgmap v1509: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:00.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:00 smithi047 ceph-mon[37680]: pgmap v1509: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:02.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:02 smithi102 ceph-mon[32821]: pgmap v1510: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:02.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:02 smithi047 ceph-mon[29365]: pgmap v1510: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:02.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:02 smithi047 ceph-mon[37680]: pgmap v1510: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:03.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:02:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:02:04.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:02:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:02:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:02:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:04 smithi102 ceph-mon[32821]: pgmap v1511: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:04.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:04 smithi047 ceph-mon[29365]: pgmap v1511: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:04.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:04.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:04 smithi047 ceph-mon[37680]: pgmap v1511: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:04.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:05.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:05.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:06 smithi102 ceph-mon[32821]: pgmap v1512: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:06.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:06 smithi047 ceph-mon[29365]: pgmap v1512: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:06.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:06 smithi047 ceph-mon[37680]: pgmap v1512: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:08.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:08 smithi102 ceph-mon[32821]: pgmap v1513: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:08.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:08 smithi047 ceph-mon[29365]: pgmap v1513: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:08.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:08 smithi047 ceph-mon[37680]: pgmap v1513: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:10 smithi102 ceph-mon[32821]: pgmap v1514: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:10 smithi047 ceph-mon[29365]: pgmap v1514: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:10.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:10 smithi047 ceph-mon[37680]: pgmap v1514: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:12.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:12 smithi102 ceph-mon[32821]: pgmap v1515: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:12.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:12 smithi047 ceph-mon[29365]: pgmap v1515: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:12.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:12 smithi047 ceph-mon[37680]: pgmap v1515: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:13.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:02:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:02:14.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:02:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:02:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:02:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:14 smithi102 ceph-mon[32821]: pgmap v1516: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:14 smithi047 ceph-mon[29365]: pgmap v1516: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:14.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:14.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:14 smithi047 ceph-mon[37680]: pgmap v1516: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:14.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:16.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:16 smithi102 ceph-mon[32821]: pgmap v1517: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:16.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:16 smithi047 ceph-mon[29365]: pgmap v1517: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:16.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:16 smithi047 ceph-mon[37680]: pgmap v1517: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:18.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:18 smithi102 ceph-mon[32821]: pgmap v1518: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:18.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:18 smithi047 ceph-mon[29365]: pgmap v1518: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:18.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:18 smithi047 ceph-mon[37680]: pgmap v1518: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:20 smithi102 ceph-mon[32821]: pgmap v1519: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:20.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:20 smithi047 ceph-mon[29365]: pgmap v1519: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:20.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:20.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:20 smithi047 ceph-mon[37680]: pgmap v1519: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:20.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:22 smithi102 ceph-mon[32821]: pgmap v1520: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:22.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:22 smithi047 ceph-mon[29365]: pgmap v1520: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:22.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:22 smithi047 ceph-mon[37680]: pgmap v1520: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:23.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:02:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:02:24.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:02:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:02:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:02:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:24 smithi102 ceph-mon[32821]: pgmap v1521: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:24.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:24 smithi047 ceph-mon[29365]: pgmap v1521: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:24.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:24.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:24 smithi047 ceph-mon[37680]: pgmap v1521: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:24.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:26 smithi102 ceph-mon[32821]: pgmap v1522: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:26.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:26 smithi047 ceph-mon[29365]: pgmap v1522: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:26.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:26 smithi047 ceph-mon[37680]: pgmap v1522: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:28 smithi102 ceph-mon[32821]: pgmap v1523: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:28.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:28 smithi047 ceph-mon[29365]: pgmap v1523: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:28.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:28 smithi047 ceph-mon[37680]: pgmap v1523: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:30 smithi102 ceph-mon[32821]: pgmap v1524: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:30.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:30 smithi047 ceph-mon[29365]: pgmap v1524: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:30.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:30 smithi047 ceph-mon[37680]: pgmap v1524: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:32.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:32 smithi102 ceph-mon[32821]: pgmap v1525: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:32.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:32 smithi047 ceph-mon[29365]: pgmap v1525: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:32.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:32 smithi047 ceph-mon[37680]: pgmap v1525: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:33.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:02:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:02:34.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:02:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:02:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:02:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:34 smithi102 ceph-mon[32821]: pgmap v1526: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:34.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:34 smithi047 ceph-mon[37680]: pgmap v1526: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:34.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:34.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:34 smithi047 ceph-mon[29365]: pgmap v1526: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:34.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:35.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:35.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:36 smithi102 ceph-mon[32821]: pgmap v1527: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:02:36.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:36 smithi047 ceph-mon[29365]: pgmap v1527: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:02:36.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:36 smithi047 ceph-mon[37680]: pgmap v1527: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:02:37.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:37 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:02:37.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:37 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:02:37.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:37 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:02:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:38 smithi047 ceph-mon[37680]: pgmap v1528: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:38 smithi047 ceph-mon[29365]: pgmap v1528: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:38.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:38 smithi102 ceph-mon[32821]: pgmap v1528: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:40.465 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:40 smithi047 ceph-mon[29365]: pgmap v1529: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:02:40.465 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:40 smithi047 ceph-mon[37680]: pgmap v1529: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:02:40.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:40 smithi102 ceph-mon[32821]: pgmap v1529: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:02:42.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[37680]: pgmap v1530: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:42.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:42.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[29365]: pgmap v1530: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:02:42.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:41 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:41 smithi102 ceph-mon[32821]: pgmap v1530: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:41 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:41 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:41 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:02:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:41 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:02:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:41 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:02:43.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:02:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:02:44.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:02:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:02:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:02:44.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:43 smithi047 ceph-mon[37680]: pgmap v1531: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:44.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:43 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:43 smithi047 ceph-mon[29365]: pgmap v1531: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:44.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:43 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:43 smithi102 ceph-mon[32821]: pgmap v1531: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:43 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:45 smithi047 ceph-mon[29365]: pgmap v1532: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:46.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:45 smithi047 ceph-mon[37680]: pgmap v1532: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:45 smithi102 ceph-mon[32821]: pgmap v1532: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:48.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:47 smithi047 ceph-mon[29365]: pgmap v1533: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:48.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:47 smithi047 ceph-mon[37680]: pgmap v1533: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:48.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:47 smithi102 ceph-mon[32821]: pgmap v1533: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:50.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:49 smithi047 ceph-mon[37680]: pgmap v1534: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:50.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:49 smithi047 ceph-mon[29365]: pgmap v1534: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:50.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:49 smithi102 ceph-mon[32821]: pgmap v1534: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:02:52.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:51 smithi047 ceph-mon[29365]: pgmap v1535: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:52.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:51 smithi047 ceph-mon[37680]: pgmap v1535: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:52.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:51 smithi102 ceph-mon[32821]: pgmap v1535: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:53.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:02:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:02:54.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:53 smithi047 ceph-mon[37680]: pgmap v1536: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:54.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:53 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:54.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:53 smithi047 ceph-mon[29365]: pgmap v1536: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:54.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:53 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:02:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:02:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:02:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:53 smithi102 ceph-mon[32821]: pgmap v1536: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:53 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:02:56.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:55 smithi047 ceph-mon[29365]: pgmap v1537: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:56.245 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:55 smithi047 ceph-mon[37680]: pgmap v1537: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:56.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:55 smithi102 ceph-mon[32821]: pgmap v1537: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:02:58.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:57 smithi047 ceph-mon[37680]: pgmap v1538: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:58.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:57 smithi047 ceph-mon[29365]: pgmap v1538: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:02:58.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:57 smithi102 ceph-mon[32821]: pgmap v1538: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:02:59 smithi047 ceph-mon[29365]: pgmap v1539: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:00.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:02:59 smithi047 ceph-mon[37680]: pgmap v1539: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:02:59 smithi102 ceph-mon[32821]: pgmap v1539: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:01 smithi047 ceph-mon[29365]: pgmap v1540: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:02.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:01 smithi047 ceph-mon[37680]: pgmap v1540: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:01 smithi102 ceph-mon[32821]: pgmap v1540: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:03.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:03:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:03:04.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:03 smithi047 ceph-mon[29365]: pgmap v1541: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:04.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:04.044 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:03:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:03:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:03:04.044 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:03 smithi047 ceph-mon[37680]: pgmap v1541: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:04.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:03 smithi102 ceph-mon[32821]: pgmap v1541: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:05.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:05.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:06.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:05 smithi047 ceph-mon[37680]: pgmap v1542: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:06.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:05 smithi047 ceph-mon[29365]: pgmap v1542: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:06.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:05 smithi102 ceph-mon[32821]: pgmap v1542: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:08.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:07 smithi047 ceph-mon[29365]: pgmap v1543: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:08.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:07 smithi047 ceph-mon[37680]: pgmap v1543: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:07 smithi102 ceph-mon[32821]: pgmap v1543: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:10.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:09 smithi047 ceph-mon[29365]: pgmap v1544: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:10.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:09 smithi047 ceph-mon[37680]: pgmap v1544: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:09 smithi102 ceph-mon[32821]: pgmap v1544: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:12.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:11 smithi047 ceph-mon[37680]: pgmap v1545: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:12.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:11 smithi047 ceph-mon[29365]: pgmap v1545: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:11 smithi102 ceph-mon[32821]: pgmap v1545: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:13.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:03:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:03:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:13 smithi047 ceph-mon[29365]: pgmap v1546: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:13 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:14.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:03:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:03:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:03:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:13 smithi047 ceph-mon[37680]: pgmap v1546: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:13 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:13 smithi102 ceph-mon[32821]: pgmap v1546: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:13 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:16.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:15 smithi047 ceph-mon[29365]: pgmap v1547: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:16.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:15 smithi047 ceph-mon[37680]: pgmap v1547: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:15 smithi102 ceph-mon[32821]: pgmap v1547: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:17.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:17 smithi047 ceph-mon[29365]: pgmap v1548: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:17.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:17 smithi047 ceph-mon[37680]: pgmap v1548: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:18.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:17 smithi102 ceph-mon[32821]: pgmap v1548: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:19 smithi047 ceph-mon[29365]: pgmap v1549: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:20.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:19 smithi047 ceph-mon[37680]: pgmap v1549: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:19 smithi102 ceph-mon[32821]: pgmap v1549: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:22.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:21 smithi047 ceph-mon[29365]: pgmap v1550: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:22.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:21 smithi047 ceph-mon[37680]: pgmap v1550: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:22.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:21 smithi102 ceph-mon[32821]: pgmap v1550: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:23.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:03:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:03:24.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:23 smithi047 ceph-mon[37680]: pgmap v1551: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:24.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:24.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:23 smithi047 ceph-mon[29365]: pgmap v1551: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:24.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:03:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:03:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:03:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:23 smithi102 ceph-mon[32821]: pgmap v1551: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:26.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:25 smithi047 ceph-mon[29365]: pgmap v1552: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:26.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:25 smithi047 ceph-mon[37680]: pgmap v1552: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:25 smithi102 ceph-mon[32821]: pgmap v1552: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:28.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:27 smithi047 ceph-mon[29365]: pgmap v1553: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:28.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:27 smithi047 ceph-mon[37680]: pgmap v1553: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:28.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:27 smithi102 ceph-mon[32821]: pgmap v1553: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:30.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:29 smithi047 ceph-mon[29365]: pgmap v1554: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:30.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:29 smithi047 ceph-mon[37680]: pgmap v1554: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:29 smithi102 ceph-mon[32821]: pgmap v1554: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:32.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:31 smithi047 ceph-mon[29365]: pgmap v1555: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:32.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:31 smithi047 ceph-mon[37680]: pgmap v1555: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:31 smithi102 ceph-mon[32821]: pgmap v1555: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:33.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:03:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:03:34.044 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:03:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:03:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:03:34.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:33 smithi047 ceph-mon[37680]: pgmap v1556: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:34.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:33 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:34.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:33 smithi047 ceph-mon[29365]: pgmap v1556: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:34.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:33 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:33 smithi102 ceph-mon[32821]: pgmap v1556: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:33 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:35.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:34 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:35.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:34 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:34 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:36.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:35 smithi047 ceph-mon[29365]: pgmap v1557: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:36.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:35 smithi047 ceph-mon[37680]: pgmap v1557: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:36.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:35 smithi102 ceph-mon[32821]: pgmap v1557: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:38.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:37 smithi102 ceph-mon[32821]: pgmap v1558: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:37 smithi047 ceph-mon[29365]: pgmap v1558: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:37 smithi047 ceph-mon[37680]: pgmap v1558: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:39 smithi102 ceph-mon[32821]: pgmap v1559: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:39 smithi047 ceph-mon[29365]: pgmap v1559: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:40.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:39 smithi047 ceph-mon[37680]: pgmap v1559: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:42.275 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:42 smithi102 ceph-mon[32821]: pgmap v1560: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:42.275 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:42 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:03:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:42 smithi047 ceph-mon[29365]: pgmap v1560: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:42 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:03:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:42 smithi047 ceph-mon[37680]: pgmap v1560: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:42 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:03:43.298 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:03:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:03:44.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:44 smithi047 ceph-mon[29365]: pgmap v1561: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:44.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:44.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:44 smithi047 ceph-mon[37680]: pgmap v1561: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:44.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:44.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:03:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:03:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:03:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:44 smithi102 ceph-mon[32821]: pgmap v1561: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[29365]: pgmap v1562: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:03:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:03:46.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:46.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[37680]: pgmap v1562: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:46.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:46.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:46.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:03:46.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:03:46.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:46 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:46 smithi102 ceph-mon[32821]: pgmap v1562: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:46 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:46 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:46 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:03:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:46 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:03:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:46 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:03:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:48 smithi047 ceph-mon[29365]: pgmap v1563: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:48 smithi047 ceph-mon[37680]: pgmap v1563: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:48 smithi102 ceph-mon[32821]: pgmap v1563: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:50 smithi047 ceph-mon[29365]: pgmap v1564: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:50.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:50 smithi047 ceph-mon[37680]: pgmap v1564: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:50 smithi102 ceph-mon[32821]: pgmap v1564: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:03:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:03:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:52 smithi047 ceph-mon[29365]: pgmap v1565: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:52.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:52 smithi047 ceph-mon[37680]: pgmap v1565: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:52 smithi102 ceph-mon[32821]: pgmap v1565: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:53.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:03:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:03:54.169 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:03:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:03:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:03:54.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:54 smithi047 ceph-mon[37680]: pgmap v1566: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:54.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:54 smithi047 ceph-mon[29365]: pgmap v1566: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:54 smithi102 ceph-mon[32821]: pgmap v1566: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:03:56.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:56 smithi047 ceph-mon[37680]: pgmap v1567: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:56.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:56 smithi047 ceph-mon[29365]: pgmap v1567: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:56.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:56 smithi102 ceph-mon[32821]: pgmap v1567: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:03:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:57 smithi047 ceph-mon[37680]: pgmap v1568: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:57.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:57 smithi047 ceph-mon[29365]: pgmap v1568: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:03:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:57 smithi102 ceph-mon[32821]: pgmap v1568: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:00.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:03:59 smithi047 ceph-mon[37680]: pgmap v1569: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:03:59 smithi047 ceph-mon[29365]: pgmap v1569: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:03:59 smithi102 ceph-mon[32821]: pgmap v1569: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:01 smithi047 ceph-mon[29365]: pgmap v1570: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:02.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:01 smithi047 ceph-mon[37680]: pgmap v1570: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:01 smithi102 ceph-mon[32821]: pgmap v1570: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:03.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:04:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:04:04.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:03 smithi047 ceph-mon[29365]: pgmap v1571: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:04.044 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:03 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:04.044 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:04:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:04:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:04:04.044 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:03 smithi047 ceph-mon[37680]: pgmap v1571: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:04.045 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:03 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:03 smithi102 ceph-mon[32821]: pgmap v1571: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:03 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:05.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:05.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:05.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:06.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:05 smithi047 ceph-mon[29365]: pgmap v1572: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:06.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:05 smithi047 ceph-mon[37680]: pgmap v1572: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:06.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:05 smithi102 ceph-mon[32821]: pgmap v1572: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:07 smithi102 ceph-mon[32821]: pgmap v1573: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:07 smithi047 ceph-mon[37680]: pgmap v1573: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:07 smithi047 ceph-mon[29365]: pgmap v1573: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:09 smithi102 ceph-mon[32821]: pgmap v1574: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:09 smithi047 ceph-mon[29365]: pgmap v1574: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:09 smithi047 ceph-mon[37680]: pgmap v1574: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:11 smithi102 ceph-mon[32821]: pgmap v1575: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:11 smithi047 ceph-mon[29365]: pgmap v1575: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:12.541 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:11 smithi047 ceph-mon[37680]: pgmap v1575: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:13.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:04:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:04:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:14 smithi047 ceph-mon[29365]: pgmap v1576: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:14.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:14.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:04:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:04:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:04:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:14 smithi047 ceph-mon[37680]: pgmap v1576: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:14.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:14 smithi102 ceph-mon[32821]: pgmap v1576: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-06T04:04:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:16.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:16 smithi047 ceph-mon[29365]: pgmap v1577: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:16.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:16 smithi047 ceph-mon[37680]: pgmap v1577: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:16 smithi102 ceph-mon[32821]: pgmap v1577: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:17.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:17 smithi047 ceph-mon[29365]: pgmap v1578: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:17.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:17 smithi047 ceph-mon[37680]: pgmap v1578: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:18.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:17 smithi102 ceph-mon[32821]: pgmap v1578: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:19 smithi047 ceph-mon[29365]: pgmap v1579: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:20.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:19 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:19 smithi047 ceph-mon[37680]: pgmap v1579: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:20.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:19 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:19 smithi102 ceph-mon[32821]: pgmap v1579: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:19 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:22.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:21 smithi047 ceph-mon[29365]: pgmap v1580: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:22.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:21 smithi047 ceph-mon[37680]: pgmap v1580: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:22.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:21 smithi102 ceph-mon[32821]: pgmap v1580: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:23.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:04:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:04:24.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:23 smithi047 ceph-mon[29365]: pgmap v1581: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:24.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:23 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:24.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:23 smithi047 ceph-mon[37680]: pgmap v1581: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:24.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:23 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:24.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:04:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:04:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:04:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:23 smithi102 ceph-mon[32821]: pgmap v1581: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:23 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:25 smithi102 ceph-mon[32821]: pgmap v1582: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:04:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:25 smithi047 ceph-mon[29365]: pgmap v1582: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:04:26.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:25 smithi047 ceph-mon[37680]: pgmap v1582: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:04:28.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:27 smithi102 ceph-mon[32821]: pgmap v1583: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:27 smithi047 ceph-mon[29365]: pgmap v1583: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:27 smithi047 ceph-mon[37680]: pgmap v1583: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:30.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:30 smithi102 ceph-mon[32821]: pgmap v1584: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:04:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:30 smithi047 ceph-mon[29365]: pgmap v1584: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:04:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:30 smithi047 ceph-mon[37680]: pgmap v1584: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:04:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:32 smithi102 ceph-mon[32821]: pgmap v1585: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:32 smithi047 ceph-mon[29365]: pgmap v1585: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:32.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:32 smithi047 ceph-mon[37680]: pgmap v1585: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:33.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:04:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:04:34.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:34 smithi047 ceph-mon[29365]: pgmap v1586: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:34.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:34.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:34 smithi047 ceph-mon[37680]: pgmap v1586: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:34.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:34.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:04:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:04:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:04:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:34 smithi102 ceph-mon[32821]: pgmap v1586: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:36.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:36 smithi102 ceph-mon[32821]: pgmap v1587: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:36 smithi047 ceph-mon[29365]: pgmap v1587: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:36 smithi047 ceph-mon[37680]: pgmap v1587: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:38.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:38 smithi102 ceph-mon[32821]: pgmap v1588: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:38 smithi047 ceph-mon[29365]: pgmap v1588: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:38 smithi047 ceph-mon[37680]: pgmap v1588: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:40 smithi102 ceph-mon[32821]: pgmap v1589: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:40 smithi047 ceph-mon[29365]: pgmap v1589: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:40.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:40 smithi047 ceph-mon[37680]: pgmap v1589: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:42 smithi102 ceph-mon[32821]: pgmap v1590: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:42 smithi047 ceph-mon[29365]: pgmap v1590: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:42 smithi047 ceph-mon[37680]: pgmap v1590: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-06T04:04:43.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:04:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:04:44.023 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:04:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:04:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:04:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:44 smithi102 ceph-mon[32821]: pgmap v1591: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:44 smithi047 ceph-mon[29365]: pgmap v1591: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:44.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:44 smithi047 ceph-mon[37680]: pgmap v1591: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:44.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:46.332 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:46 smithi102 ceph-mon[32821]: pgmap v1592: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:46.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:46 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:04:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:46 smithi047 ceph-mon[29365]: pgmap v1592: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:46 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:04:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:46 smithi047 ceph-mon[37680]: pgmap v1592: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:46 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:04:47.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[37680]: pgmap v1593: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:47 smithi047 ceph-mon[29365]: pgmap v1593: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:47.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:47 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:47 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:47 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:04:47.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:47 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:04:47.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:47 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:04:47.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:47 smithi102 ceph-mon[32821]: pgmap v1593: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:49 smithi102 ceph-mon[32821]: pgmap v1594: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:49 smithi047 ceph-mon[29365]: pgmap v1594: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:50.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:49 smithi047 ceph-mon[37680]: pgmap v1594: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:50.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:04:52.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:52 smithi102 ceph-mon[32821]: pgmap v1595: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:52 smithi047 ceph-mon[29365]: pgmap v1595: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:52.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:52 smithi047 ceph-mon[37680]: pgmap v1595: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:53.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:04:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:04:54.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:54 smithi047 ceph-mon[29365]: pgmap v1596: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:54.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:54.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:04:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:04:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:04:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:54 smithi047 ceph-mon[37680]: pgmap v1596: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:54.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:54 smithi102 ceph-mon[32821]: pgmap v1596: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:54.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:04:56.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:56 smithi102 ceph-mon[32821]: pgmap v1597: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:56.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:56 smithi047 ceph-mon[29365]: pgmap v1597: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:56.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:56 smithi047 ceph-mon[37680]: pgmap v1597: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:04:58.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:04:58 smithi102 ceph-mon[32821]: pgmap v1598: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:58.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:04:58 smithi047 ceph-mon[29365]: pgmap v1598: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:04:58.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:04:58 smithi047 ceph-mon[37680]: pgmap v1598: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:00.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:00 smithi102 ceph-mon[32821]: pgmap v1599: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:00.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:00 smithi047 ceph-mon[29365]: pgmap v1599: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:00.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:00 smithi047 ceph-mon[37680]: pgmap v1599: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:02 smithi102 ceph-mon[32821]: pgmap v1600: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:02.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:02 smithi047 ceph-mon[29365]: pgmap v1600: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:02.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:02 smithi047 ceph-mon[37680]: pgmap v1600: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:03.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:05:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:05:04.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:05:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:05:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:05:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:04 smithi047 ceph-mon[29365]: pgmap v1601: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:04.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:04.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:04 smithi047 ceph-mon[37680]: pgmap v1601: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:04.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:04 smithi102 ceph-mon[32821]: pgmap v1601: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:05.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:06.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:06 smithi102 ceph-mon[32821]: pgmap v1602: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:06.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:06 smithi047 ceph-mon[29365]: pgmap v1602: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:06 smithi047 ceph-mon[37680]: pgmap v1602: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:08 smithi102 ceph-mon[32821]: pgmap v1603: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:08 smithi047 ceph-mon[29365]: pgmap v1603: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:08 smithi047 ceph-mon[37680]: pgmap v1603: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:10 smithi102 ceph-mon[32821]: pgmap v1604: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:10 smithi047 ceph-mon[29365]: pgmap v1604: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:10.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:10 smithi047 ceph-mon[37680]: pgmap v1604: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:12 smithi102 ceph-mon[32821]: pgmap v1605: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:12 smithi047 ceph-mon[29365]: pgmap v1605: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:12 smithi047 ceph-mon[37680]: pgmap v1605: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:13.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:05:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:05:14.036 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:05:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:05:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:05:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:14 smithi102 ceph-mon[32821]: pgmap v1606: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:14 smithi047 ceph-mon[29365]: pgmap v1606: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:14 smithi047 ceph-mon[37680]: pgmap v1606: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:16 smithi102 ceph-mon[32821]: pgmap v1607: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:16 smithi047 ceph-mon[29365]: pgmap v1607: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:16.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:16 smithi047 ceph-mon[37680]: pgmap v1607: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:18 smithi102 ceph-mon[32821]: pgmap v1608: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:18 smithi047 ceph-mon[29365]: pgmap v1608: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:18 smithi047 ceph-mon[37680]: pgmap v1608: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:20 smithi102 ceph-mon[32821]: pgmap v1609: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:20 smithi047 ceph-mon[29365]: pgmap v1609: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:20 smithi047 ceph-mon[37680]: pgmap v1609: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:22.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:22 smithi102 ceph-mon[32821]: pgmap v1610: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:22 smithi047 ceph-mon[29365]: pgmap v1610: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:22.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:22 smithi047 ceph-mon[37680]: pgmap v1610: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:23.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:05:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:05:24.050 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:05:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:05:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:05:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:24 smithi102 ceph-mon[32821]: pgmap v1611: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:24 smithi047 ceph-mon[29365]: pgmap v1611: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:24 smithi047 ceph-mon[37680]: pgmap v1611: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:26 smithi102 ceph-mon[32821]: pgmap v1612: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:26 smithi047 ceph-mon[29365]: pgmap v1612: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:26.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:26 smithi047 ceph-mon[37680]: pgmap v1612: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:28.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:28 smithi102 ceph-mon[32821]: pgmap v1613: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:28 smithi047 ceph-mon[29365]: pgmap v1613: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:28 smithi047 ceph-mon[37680]: pgmap v1613: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:30.333 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:05:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=cleanup t=2024-04-06T04:05:30.203503281Z level=info msg="Completed cleanup jobs" duration=2.637512ms 2024-04-06T04:05:30.334 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:30 smithi102 ceph-mon[32821]: pgmap v1614: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:30 smithi047 ceph-mon[29365]: pgmap v1614: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:30 smithi047 ceph-mon[37680]: pgmap v1614: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:32.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:32 smithi102 ceph-mon[32821]: pgmap v1615: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:32.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:32 smithi047 ceph-mon[37680]: pgmap v1615: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:32 smithi047 ceph-mon[29365]: pgmap v1615: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:33.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:05:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:05:34.064 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:05:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:05:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:05:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:34 smithi102 ceph-mon[32821]: pgmap v1616: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:34.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:34 smithi047 ceph-mon[29365]: pgmap v1616: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:34 smithi047 ceph-mon[37680]: pgmap v1616: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:35.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:36.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:36 smithi102 ceph-mon[32821]: pgmap v1617: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:36 smithi047 ceph-mon[29365]: pgmap v1617: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:36 smithi047 ceph-mon[37680]: pgmap v1617: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:38.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:38 smithi102 ceph-mon[32821]: pgmap v1618: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:38 smithi047 ceph-mon[29365]: pgmap v1618: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:38 smithi047 ceph-mon[37680]: pgmap v1618: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:40.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:40 smithi102 ceph-mon[32821]: pgmap v1619: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:40 smithi047 ceph-mon[29365]: pgmap v1619: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:40.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:40 smithi047 ceph-mon[37680]: pgmap v1619: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:42 smithi102 ceph-mon[32821]: pgmap v1620: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:42 smithi047 ceph-mon[29365]: pgmap v1620: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:42 smithi047 ceph-mon[37680]: pgmap v1620: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:43.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:05:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:05:44.082 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:05:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:05:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:05:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:44 smithi102 ceph-mon[32821]: pgmap v1621: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:44.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:44 smithi047 ceph-mon[29365]: pgmap v1621: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:44 smithi047 ceph-mon[37680]: pgmap v1621: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:46 smithi047 ceph-mon[29365]: pgmap v1622: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:46 smithi047 ceph-mon[37680]: pgmap v1622: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:46 smithi102 ceph-mon[32821]: pgmap v1622: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:05:47.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:47 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:05:47.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:47 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:05:47.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:47 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:05:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[29365]: pgmap v1623: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:05:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:05:48.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[37680]: pgmap v1623: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:05:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:05:48.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:48 smithi102 ceph-mon[32821]: pgmap v1623: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:05:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:05:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:05:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:50 smithi047 ceph-mon[29365]: pgmap v1624: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:50.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:50 smithi047 ceph-mon[37680]: pgmap v1624: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:50 smithi102 ceph-mon[32821]: pgmap v1624: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:05:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:52 smithi047 ceph-mon[29365]: pgmap v1625: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:52.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:52 smithi047 ceph-mon[37680]: pgmap v1625: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:52 smithi102 ceph-mon[32821]: pgmap v1625: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:53.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:05:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:05:54.100 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:05:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:05:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:05:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:54 smithi047 ceph-mon[29365]: pgmap v1626: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:54 smithi047 ceph-mon[37680]: pgmap v1626: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:54 smithi102 ceph-mon[32821]: pgmap v1626: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:05:56.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:56 smithi047 ceph-mon[29365]: pgmap v1627: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:56.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:56 smithi047 ceph-mon[37680]: pgmap v1627: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:56.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:56 smithi102 ceph-mon[32821]: pgmap v1627: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:05:58.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:05:58 smithi047 ceph-mon[29365]: pgmap v1628: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:58.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:05:58 smithi047 ceph-mon[37680]: pgmap v1628: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:05:58.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:05:58 smithi102 ceph-mon[32821]: pgmap v1628: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:00.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:00 smithi047 ceph-mon[29365]: pgmap v1629: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:00.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:00 smithi047 ceph-mon[37680]: pgmap v1629: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:00 smithi102 ceph-mon[32821]: pgmap v1629: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:02.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:02 smithi047 ceph-mon[29365]: pgmap v1630: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:02.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:02 smithi047 ceph-mon[37680]: pgmap v1630: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:02.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:02 smithi102 ceph-mon[32821]: pgmap v1630: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:03.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:06:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:06:04.115 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:06:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:06:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:06:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:04 smithi047 ceph-mon[29365]: pgmap v1631: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:04.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:04.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:04 smithi047 ceph-mon[37680]: pgmap v1631: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:04.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:04 smithi102 ceph-mon[32821]: pgmap v1631: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:05.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:05.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:06.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:06 smithi047 ceph-mon[29365]: pgmap v1632: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:06 smithi047 ceph-mon[37680]: pgmap v1632: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:06 smithi102 ceph-mon[32821]: pgmap v1632: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:08 smithi047 ceph-mon[29365]: pgmap v1633: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:08 smithi047 ceph-mon[37680]: pgmap v1633: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:08.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:08 smithi102 ceph-mon[32821]: pgmap v1633: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:10 smithi047 ceph-mon[29365]: pgmap v1634: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:10 smithi047 ceph-mon[37680]: pgmap v1634: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:10 smithi102 ceph-mon[32821]: pgmap v1634: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:12 smithi047 ceph-mon[29365]: pgmap v1635: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:12 smithi047 ceph-mon[37680]: pgmap v1635: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:12.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:12 smithi102 ceph-mon[32821]: pgmap v1635: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:13.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:06:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:06:14.133 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:06:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:06:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:06:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:14 smithi047 ceph-mon[37680]: pgmap v1636: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:14 smithi047 ceph-mon[29365]: pgmap v1636: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:14.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:14 smithi102 ceph-mon[32821]: pgmap v1636: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:16 smithi047 ceph-mon[29365]: pgmap v1637: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:16.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:16 smithi047 ceph-mon[37680]: pgmap v1637: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:16.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:16 smithi102 ceph-mon[32821]: pgmap v1637: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:18 smithi047 ceph-mon[29365]: pgmap v1638: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:18 smithi047 ceph-mon[37680]: pgmap v1638: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:18.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:18 smithi102 ceph-mon[32821]: pgmap v1638: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:20 smithi047 ceph-mon[37680]: pgmap v1639: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:20 smithi047 ceph-mon[29365]: pgmap v1639: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:20 smithi102 ceph-mon[32821]: pgmap v1639: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:22 smithi047 ceph-mon[29365]: pgmap v1640: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:22.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:22 smithi047 ceph-mon[37680]: pgmap v1640: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:22 smithi102 ceph-mon[32821]: pgmap v1640: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:23.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:06:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:06:24.147 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:06:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:06:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:06:24.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:24 smithi047 ceph-mon[37680]: pgmap v1641: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:24.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:24 smithi047 ceph-mon[29365]: pgmap v1641: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:24 smithi102 ceph-mon[32821]: pgmap v1641: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:26.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:26 smithi047 ceph-mon[37680]: pgmap v1642: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:26 smithi047 ceph-mon[29365]: pgmap v1642: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:26 smithi102 ceph-mon[32821]: pgmap v1642: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:28 smithi047 ceph-mon[29365]: pgmap v1643: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:28 smithi047 ceph-mon[37680]: pgmap v1643: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:28 smithi102 ceph-mon[32821]: pgmap v1643: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:30 smithi047 ceph-mon[29365]: pgmap v1644: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:30 smithi047 ceph-mon[37680]: pgmap v1644: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:30 smithi102 ceph-mon[32821]: pgmap v1644: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:06:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:32 smithi047 ceph-mon[29365]: pgmap v1645: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:32.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:32 smithi047 ceph-mon[37680]: pgmap v1645: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:32.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:32 smithi102 ceph-mon[32821]: pgmap v1645: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:33.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:06:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:06:34.162 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:06:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:06:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:06:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:34 smithi047 ceph-mon[29365]: pgmap v1646: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:34 smithi047 ceph-mon[37680]: pgmap v1646: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:34.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:34 smithi102 ceph-mon[32821]: pgmap v1646: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:36 smithi047 ceph-mon[29365]: pgmap v1647: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:36 smithi047 ceph-mon[37680]: pgmap v1647: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:36 smithi102 ceph-mon[32821]: pgmap v1647: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:38 smithi047 ceph-mon[29365]: pgmap v1648: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:38 smithi047 ceph-mon[37680]: pgmap v1648: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:38 smithi102 ceph-mon[32821]: pgmap v1648: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:40 smithi047 ceph-mon[29365]: pgmap v1649: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:40.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:40 smithi047 ceph-mon[37680]: pgmap v1649: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:40.582 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:40 smithi102 ceph-mon[32821]: pgmap v1649: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:40.810 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_1_[75279]: starting. 2024-04-06T04:06:40.810 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_1_[75279]: creating pool ceph_test_rados_list_parallel.smithi047-75223 2024-04-06T04:06:40.810 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_1_[75279]: created object 0... 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_1_[75279]: created object 25... 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_1_[75279]: created object 49... 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_1_[75279]: finishing. 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_1_[75279]: shutting down. 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_2_[75284]: starting. 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_2_[75284]: listing objects. 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_2_[75284]: listed object 0... 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_2_[75284]: listed object 25... 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_2_[75284]: saw 50 objects 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_2_[75284]: shutting down. 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.811 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_3_[149889]: starting. 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_3_[149889]: creating pool ceph_test_rados_list_parallel.smithi047-75223 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_3_[149889]: created object 0... 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_3_[149889]: created object 25... 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_3_[149889]: created object 49... 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_3_[149889]: finishing. 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_3_[149889]: shutting down. 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_4_[149890]: starting. 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_4_[149890]: listing objects. 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_4_[149890]: listed object 0... 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_4_[149890]: listed object 25... 2024-04-06T04:06:40.812 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_4_[149890]: saw 42 objects 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_4_[149890]: shutting down. 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_5_[149891]: starting. 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_5_[149891]: removed 25 objects... 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_5_[149891]: removed half of the objects 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_5_[149891]: removed 50 objects... 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_5_[149891]: removed 50 objects 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_5_[149891]: shutting down. 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_6_[149937]: starting. 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_6_[149937]: creating pool ceph_test_rados_list_parallel.smithi047-75223 2024-04-06T04:06:40.813 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_6_[149937]: created object 0... 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_6_[149937]: created object 25... 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_6_[149937]: created object 49... 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_6_[149937]: finishing. 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_6_[149937]: shutting down. 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_7_[149938]: starting. 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_7_[149938]: listing objects. 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_7_[149938]: listed object 0... 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_7_[149938]: listed object 25... 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_7_[149938]: listed object 50... 2024-04-06T04:06:40.814 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_7_[149938]: saw 56 objects 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_7_[149938]: shutting down. 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_8_[149939]: starting. 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_8_[149939]: added 25 objects... 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_8_[149939]: added half of the objects 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_8_[149939]: added 50 objects... 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_8_[149939]: added 50 objects 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_8_[149939]: shutting down. 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.815 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.982 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.982 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_9_[149985]: starting. 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_9_[149985]: creating pool ceph_test_rados_list_parallel.smithi047-75223 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_9_[149985]: created object 0... 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_9_[149985]: created object 25... 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_9_[149985]: created object 49... 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_9_[149985]: finishing. 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_9_[149985]: shutting down. 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_10_[149986]: starting. 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_10_[149986]: listing objects. 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_10_[149986]: listed object 0... 2024-04-06T04:06:40.983 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_10_[149986]: listed object 25... 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_10_[149986]: listed object 50... 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_10_[149986]: listed object 75... 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_10_[149986]: saw 97 objects 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_10_[149986]: shutting down. 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_13_[149989]: starting. 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_13_[149989]: removed 25 objects... 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_13_[149989]: removed half of the objects 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_13_[149989]: removed 50 objects... 2024-04-06T04:06:40.984 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_13_[149989]: removed 50 objects 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_13_[149989]: shutting down. 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_11_[149987]: starting. 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_11_[149987]: added 25 objects... 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_11_[149987]: added half of the objects 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_11_[149987]: added 50 objects... 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_11_[149987]: added 50 objects 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_11_[149987]: shutting down. 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.985 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_12_[149988]: starting. 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_12_[149988]: added 25 objects... 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_12_[149988]: added half of the objects 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_12_[149988]: added 50 objects... 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_12_[149988]: added 50 objects 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_12_[149988]: shutting down. 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_14_[150065]: starting. 2024-04-06T04:06:40.986 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_14_[150065]: creating pool ceph_test_rados_list_parallel.smithi047-75223 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_14_[150065]: created object 0... 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_14_[150065]: created object 25... 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_14_[150065]: created object 49... 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_14_[150065]: finishing. 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_14_[150065]: shutting down. 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: starting. 2024-04-06T04:06:40.987 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: listing objects. 2024-04-06T04:06:41.187 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: listed object 0... 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: listed object 25... 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: listed object 50... 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: listed object 75... 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: listed object 100... 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: listed object 125... 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: saw 150 objects 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_15_[150066]: shutting down. 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.188 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_16_[150067]: starting. 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_16_[150067]: added 25 objects... 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_16_[150067]: added half of the objects 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_16_[150067]: added 50 objects... 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_16_[150067]: added 50 objects 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: process_16_[150067]: shutting down. 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******************************* 2024-04-06T04:06:41.189 INFO:tasks.workunit.client.0.smithi047.stdout: list_parallel: ******* SUCCESS ********** 2024-04-06T04:06:41.190 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.190 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74415 2024-04-06T04:06:41.190 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74415 2024-04-06T04:06:41.190 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.190 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74435 2024-04-06T04:06:41.190 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74435 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75610 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75610 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74702 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74702 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75647 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75647 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74806 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74806 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75328 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75328 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75688 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75688 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74729 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74729 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75183 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75183 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75581 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75581 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75300 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75300 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75632 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75632 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75062 2024-04-06T04:06:41.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75062 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74634 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74634 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75659 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75659 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74927 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74927 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74408 2024-04-06T04:06:41.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74408 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74468 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74468 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74867 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74867 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=74507 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 74507 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75014 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75014 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75022 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75022 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75550 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75550 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ for t in "${!pids[@]}" 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=75719 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 75719 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ exit 0 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ cleanup 2024-04-06T04:06:41.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ pkill -P 74402 2024-04-06T04:06:41.211 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-04-06T04:06:41.211 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-06T04:06:41.212 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-06T04:06:41.241 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-04-06T04:06:41.242 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-04-06T04:06:41.242 DEBUG:teuthology.orchestra.run.smithi047:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=584a67ccb9eb224c5312dccd96a82e67b0645518 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-04-06T04:06:41.299 INFO:tasks.workunit.client.0.smithi047.stderr:++ uuidgen 2024-04-06T04:06:41.308 INFO:tasks.workunit.client.0.smithi047.stderr:+ p=221d75c7-d61e-469a-8866-a0e9906e6a82 2024-04-06T04:06:41.308 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool create 221d75c7-d61e-469a-8866-a0e9906e6a82 12 2024-04-06T04:06:41.394 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 -- 172.21.15.47:0/3565779408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8634101060 msgr2=0x7f863410d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:41.394 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 --2- 172.21.15.47:0/3565779408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8634101060 0x7f863410d570 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f862c009cd0 tx=0x7f862c02c0f0 comp rx=0 tx=0).stop 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 -- 172.21.15.47:0/3565779408 shutdown_connections 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 --2- 172.21.15.47:0/3565779408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8634101060 0x7f863410d570 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 --2- 172.21.15.47:0/3565779408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86341006a0 0x7f8634100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 --2- 172.21.15.47:0/3565779408 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86341066b0 0x7f8634106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 -- 172.21.15.47:0/3565779408 >> 172.21.15.47:0/3565779408 conn(0x7f8634077800 msgr2=0x7f8634077c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 -- 172.21.15.47:0/3565779408 shutdown_connections 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 -- 172.21.15.47:0/3565779408 wait complete. 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.392+0000 7f863a0d5640 1 Processor -- start 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f863a0d5640 1 -- start start 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f863a0d5640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86341006a0 0x7f86341985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f863a0d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8634101060 0x7f8634198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f863a0d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86341066b0 0x7f86341a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f863a0d5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8634110190 con 0x7f8634101060 2024-04-06T04:06:41.395 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f863a0d5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8634110010 con 0x7f86341066b0 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f863a0d5640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8634110310 con 0x7f86341006a0 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86341006a0 0x7f86341985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f8632ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8634101060 0x7f8634198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86341006a0 0x7f86341985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:41650/0 (socket says 172.21.15.47:41650) 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 -- 172.21.15.47:0/362962504 learned_addr learned my addr 172.21.15.47:0/362962504 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f8633fff640 1 --2- 172.21.15.47:0/362962504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86341066b0 0x7f86341a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 -- 172.21.15.47:0/362962504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86341066b0 msgr2=0x7f86341a3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 --2- 172.21.15.47:0/362962504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86341066b0 0x7f86341a3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 -- 172.21.15.47:0/362962504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8634101060 msgr2=0x7f8634198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 --2- 172.21.15.47:0/362962504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8634101060 0x7f8634198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 -- 172.21.15.47:0/362962504 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86341a3b90 con 0x7f86341006a0 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f86337fe640 1 --2- 172.21.15.47:0/362962504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86341006a0 0x7f86341985d0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f862400ea60 tx=0x7f862400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.393+0000 7f8630ff9640 1 -- 172.21.15.47:0/362962504 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862400cde0 con 0x7f86341006a0 2024-04-06T04:06:41.396 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.394+0000 7f8630ff9640 1 -- 172.21.15.47:0/362962504 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f86240035f0 con 0x7f86341006a0 2024-04-06T04:06:41.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.394+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86341a3d60 con 0x7f86341006a0 2024-04-06T04:06:41.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.394+0000 7f8630ff9640 1 -- 172.21.15.47:0/362962504 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624010690 con 0x7f86341006a0 2024-04-06T04:06:41.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.394+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f86341a4220 con 0x7f86341006a0 2024-04-06T04:06:41.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.394+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86340686c0 con 0x7f86341006a0 2024-04-06T04:06:41.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.395+0000 7f8630ff9640 1 -- 172.21.15.47:0/362962504 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f8624004000 con 0x7f86341006a0 2024-04-06T04:06:41.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.395+0000 7f8630ff9640 1 --2- 172.21.15.47:0/362962504 >> v2:172.21.15.47:6800/3359778320 conn(0x7f861c06db70 0x7f861c070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:41.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.395+0000 7f8630ff9640 1 -- 172.21.15.47:0/362962504 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(755..755 src has 254..755) ==== 7430+0+0 (secure 0 0 0) 0x7f862408e230 con 0x7f86341006a0 2024-04-06T04:06:41.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.395+0000 7f8632ffd640 1 --2- 172.21.15.47:0/362962504 >> v2:172.21.15.47:6800/3359778320 conn(0x7f861c06db70 0x7f861c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:41.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.396+0000 7f8632ffd640 1 --2- 172.21.15.47:0/362962504 >> v2:172.21.15.47:6800/3359778320 conn(0x7f861c06db70 0x7f861c070030 secure :-1 s=READY pgs=3409 cs=0 l=1 rev1=1 crypto rx=0x7f8634069660 tx=0x7f8628005f90 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:06:41.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.400+0000 7f8630ff9640 1 -- 172.21.15.47:0/362962504 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f86240042f0 con 0x7f86341006a0 2024-04-06T04:06:41.584 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:41.583+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12} v 0) -- 0x7f8634108c10 con 0x7f86341006a0 2024-04-06T04:06:42.188 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.187+0000 7f8630ff9640 1 -- 172.21.15.47:0/362962504 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]=0 pool '221d75c7-d61e-469a-8866-a0e9906e6a82' created v756) ==== 176+0+0 (secure 0 0 0) 0x7f862405f230 con 0x7f86341006a0 2024-04-06T04:06:42.299 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.298+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12} v 0) -- 0x7f8634108680 con 0x7f86341006a0 2024-04-06T04:06:42.299 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.299+0000 7f8630ff9640 1 -- 172.21.15.47:0/362962504 <== mon.2 v2:172.21.15.47:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]=0 pool '221d75c7-d61e-469a-8866-a0e9906e6a82' already exists v756) ==== 183+0+0 (secure 0 0 0) 0x7f8624063a60 con 0x7f86341006a0 2024-04-06T04:06:42.300 INFO:tasks.workunit.client.0.smithi047.stderr:pool '221d75c7-d61e-469a-8866-a0e9906e6a82' already exists 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 >> v2:172.21.15.47:6800/3359778320 conn(0x7f861c06db70 msgr2=0x7f861c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 --2- 172.21.15.47:0/362962504 >> v2:172.21.15.47:6800/3359778320 conn(0x7f861c06db70 0x7f861c070030 secure :-1 s=READY pgs=3409 cs=0 l=1 rev1=1 crypto rx=0x7f8634069660 tx=0x7f8628005f90 comp rx=0 tx=0).stop 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86341006a0 msgr2=0x7f86341985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 --2- 172.21.15.47:0/362962504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86341006a0 0x7f86341985d0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f862400ea60 tx=0x7f862400ef20 comp rx=0 tx=0).stop 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 shutdown_connections 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 --2- 172.21.15.47:0/362962504 >> v2:172.21.15.47:6800/3359778320 conn(0x7f861c06db70 0x7f861c070030 unknown :-1 s=CLOSED pgs=3409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 --2- 172.21.15.47:0/362962504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86341066b0 0x7f86341a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 --2- 172.21.15.47:0/362962504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8634101060 0x7f8634198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 --2- 172.21.15.47:0/362962504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86341006a0 0x7f86341985d0 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.302 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 >> 172.21.15.47:0/362962504 conn(0x7f8634077800 msgr2=0x7f86341032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:06:42.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 shutdown_connections 2024-04-06T04:06:42.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.301+0000 7f863a0d5640 1 -- 172.21.15.47:0/362962504 wait complete. 2024-04-06T04:06:42.310 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool set-quota 221d75c7-d61e-469a-8866-a0e9906e6a82 max_objects 10 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 -- 172.21.15.47:0/2905562544 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c1017b0 msgr2=0x7f545c101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 --2- 172.21.15.47:0/2905562544 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c1017b0 0x7f545c101c30 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7f544c009890 tx=0x7f544c02bb70 comp rx=0 tx=0).stop 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 -- 172.21.15.47:0/2905562544 shutdown_connections 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 --2- 172.21.15.47:0/2905562544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c102170 0x7f545c10e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 --2- 172.21.15.47:0/2905562544 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c1017b0 0x7f545c101c30 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 --2- 172.21.15.47:0/2905562544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f545c1077c0 0x7f545c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 -- 172.21.15.47:0/2905562544 >> 172.21.15.47:0/2905562544 conn(0x7f545c0fd2c0 msgr2=0x7f545c0ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 -- 172.21.15.47:0/2905562544 shutdown_connections 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 -- 172.21.15.47:0/2905562544 wait complete. 2024-04-06T04:06:42.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 Processor -- start 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.394+0000 7f546431e640 1 -- start start 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f546431e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f545c1017b0 0x7f545c19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f546431e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c102170 0x7f545c19dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f546431e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c1077c0 0x7f545c197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f546431e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1112e0 con 0x7f545c1077c0 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f546431e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f545c111160 con 0x7f545c1017b0 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f546431e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f545c111460 con 0x7f545c102170 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c1077c0 0x7f545c197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54618b9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c102170 0x7f545c19dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c1077c0 0x7f545c197660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44884/0 (socket says 172.21.15.47:44884) 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 -- 172.21.15.47:0/2074004742 learned_addr learned my addr 172.21.15.47:0/2074004742 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54618b9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c102170 0x7f545c19dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:41676/0 (socket says 172.21.15.47:41676) 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54620ba640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f545c1017b0 0x7f545c19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:42.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 -- 172.21.15.47:0/2074004742 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c102170 msgr2=0x7f545c19dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c102170 0x7f545c19dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 -- 172.21.15.47:0/2074004742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f545c1017b0 msgr2=0x7f545c19d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f545c1017b0 0x7f545c19d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 -- 172.21.15.47:0/2074004742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c197f20 con 0x7f545c1077c0 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54618b9640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c102170 0x7f545c19dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54628bb640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c1077c0 0x7f545c197660 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f545400efc0 tx=0x7f545400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54537fe640 1 -- 172.21.15.47:0/2074004742 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454003970 con 0x7f545c1077c0 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c198210 con 0x7f545c1077c0 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54537fe640 1 -- 172.21.15.47:0/2074004742 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f5454004020 con 0x7f545c1077c0 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f54537fe640 1 -- 172.21.15.47:0/2074004742 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545400b930 con 0x7f545c1077c0 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.395+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c1a4520 con 0x7f545c1077c0 2024-04-06T04:06:42.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.396+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c102ef0 con 0x7f545c1077c0 2024-04-06T04:06:42.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.397+0000 7f54537fe640 1 -- 172.21.15.47:0/2074004742 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f545401d020 con 0x7f545c1077c0 2024-04-06T04:06:42.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.397+0000 7f54537fe640 1 --2- 172.21.15.47:0/2074004742 >> v2:172.21.15.47:6800/3359778320 conn(0x7f544806db70 0x7f5448070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:42.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.397+0000 7f54620ba640 1 --2- 172.21.15.47:0/2074004742 >> v2:172.21.15.47:6800/3359778320 conn(0x7f544806db70 0x7f5448070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:42.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.397+0000 7f54537fe640 1 -- 172.21.15.47:0/2074004742 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(756..756 src has 254..756) ==== 7805+0+0 (secure 0 0 0) 0x7f545408df40 con 0x7f545c1077c0 2024-04-06T04:06:42.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.398+0000 7f54620ba640 1 --2- 172.21.15.47:0/2074004742 >> v2:172.21.15.47:6800/3359778320 conn(0x7f544806db70 0x7f5448070030 secure :-1 s=READY pgs=3410 cs=0 l=1 rev1=1 crypto rx=0x7f5458005fd0 tx=0x7f545800b390 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:06:42.403 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.402+0000 7f54537fe640 1 -- 172.21.15.47:0/2074004742 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f545405ee70 con 0x7f545c1077c0 2024-04-06T04:06:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:42 smithi047 ceph-mon[37680]: pgmap v1650: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:42 smithi047 ceph-mon[37680]: osdmap e755: 8 total, 8 up, 8 in 2024-04-06T04:06:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:42 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/362962504' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:42 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:42 smithi047 ceph-mon[29365]: pgmap v1650: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:42.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:42 smithi047 ceph-mon[29365]: osdmap e755: 8 total, 8 up, 8 in 2024-04-06T04:06:42.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:42 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/362962504' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:42.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:42 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:42 smithi102 ceph-mon[32821]: pgmap v1650: 196 pgs: 196 active+clean; 582 KiB data, 830 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:06:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:42 smithi102 ceph-mon[32821]: osdmap e755: 8 total, 8 up, 8 in 2024-04-06T04:06:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:42 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/362962504' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:42 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:42.588 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:42.588+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"} v 0) -- 0x7f545c109d40 con 0x7f545c1077c0 2024-04-06T04:06:43.189 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:43.189+0000 7f54537fe640 1 -- 172.21.15.47:0/2074004742 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v757) ==== 223+0+0 (secure 0 0 0) 0x7f54540636a0 con 0x7f545c1077c0 2024-04-06T04:06:43.312 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:43.312+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"} v 0) -- 0x7f545c198440 con 0x7f545c1077c0 2024-04-06T04:06:43.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]': finished 2024-04-06T04:06:43.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[29365]: osdmap e756: 8 total, 8 up, 8 in 2024-04-06T04:06:43.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/362962504' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:43.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:43.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:06:43.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]': finished 2024-04-06T04:06:43.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[37680]: osdmap e756: 8 total, 8 up, 8 in 2024-04-06T04:06:43.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/362962504' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:43.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:43.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:06:43.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:06:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:06:43.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]': finished 2024-04-06T04:06:43.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:43 smithi102 ceph-mon[32821]: osdmap e756: 8 total, 8 up, 8 in 2024-04-06T04:06:43.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/362962504' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:43.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:43 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pg_num": 12}]: dispatch 2024-04-06T04:06:43.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:43 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:06:44.191 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:06:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:06:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:06:44.195 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.194+0000 7f54537fe640 1 -- 172.21.15.47:0/2074004742 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v758) ==== 223+0+0 (secure 0 0 0) 0x7f54540044b0 con 0x7f545c1077c0 2024-04-06T04:06:44.195 INFO:tasks.workunit.client.0.smithi047.stderr:set-quota max_objects = 10 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 2024-04-06T04:06:44.199 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.198+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 >> v2:172.21.15.47:6800/3359778320 conn(0x7f544806db70 msgr2=0x7f5448070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:44.199 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 --2- 172.21.15.47:0/2074004742 >> v2:172.21.15.47:6800/3359778320 conn(0x7f544806db70 0x7f5448070030 secure :-1 s=READY pgs=3410 cs=0 l=1 rev1=1 crypto rx=0x7f5458005fd0 tx=0x7f545800b390 comp rx=0 tx=0).stop 2024-04-06T04:06:44.199 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c1077c0 msgr2=0x7f545c197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:44.199 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c1077c0 0x7f545c197660 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f545400efc0 tx=0x7f545400c800 comp rx=0 tx=0).stop 2024-04-06T04:06:44.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 shutdown_connections 2024-04-06T04:06:44.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 --2- 172.21.15.47:0/2074004742 >> v2:172.21.15.47:6800/3359778320 conn(0x7f544806db70 0x7f5448070030 unknown :-1 s=CLOSED pgs=3410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c1077c0 0x7f545c197660 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f545c102170 0x7f545c19dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 --2- 172.21.15.47:0/2074004742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f545c1017b0 0x7f545c19d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 >> 172.21.15.47:0/2074004742 conn(0x7f545c0fd2c0 msgr2=0x7f545c0fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:06:44.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.199+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 shutdown_connections 2024-04-06T04:06:44.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.200+0000 7f546431e640 1 -- 172.21.15.47:0/2074004742 wait complete. 2024-04-06T04:06:44.211 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool application enable 221d75c7-d61e-469a-8866-a0e9906e6a82 rados 2024-04-06T04:06:44.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 -- 172.21.15.47:0/4147093949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 msgr2=0x7fc794101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:44.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 --2- 172.21.15.47:0/4147093949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 0x7fc794101c30 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fc788009890 tx=0x7fc78802bb70 comp rx=0 tx=0).stop 2024-04-06T04:06:44.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 -- 172.21.15.47:0/4147093949 shutdown_connections 2024-04-06T04:06:44.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 --2- 172.21.15.47:0/4147093949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc794102170 0x7fc79410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 --2- 172.21.15.47:0/4147093949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 0x7fc794101c30 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 --2- 172.21.15.47:0/4147093949 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7941077c0 0x7fc794107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 -- 172.21.15.47:0/4147093949 >> 172.21.15.47:0/4147093949 conn(0x7fc7940fd2e0 msgr2=0x7fc7940ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:06:44.303 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 -- 172.21.15.47:0/4147093949 shutdown_connections 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.300+0000 7fc7988de640 1 -- 172.21.15.47:0/4147093949 wait complete. 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc7988de640 1 Processor -- start 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc7988de640 1 -- start start 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc7988de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 0x7fc79419d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc7988de640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc794102170 0x7fc79419d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc7988de640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7941077c0 0x7fc794197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc7988de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7941112a0 con 0x7fc7941017b0 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc7988de640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc794111120 con 0x7fc7941077c0 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc7988de640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc794111420 con 0x7fc794102170 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc79259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 0x7fc79419d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc791d9b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc794102170 0x7fc79419d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc79259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 0x7fc79419d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44888/0 (socket says 172.21.15.47:44888) 2024-04-06T04:06:44.304 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc79259c640 1 -- 172.21.15.47:0/516258780 learned_addr learned my addr 172.21.15.47:0/516258780 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc792d9d640 1 --2- 172.21.15.47:0/516258780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7941077c0 0x7fc794197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc79259c640 1 -- 172.21.15.47:0/516258780 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc794102170 msgr2=0x7fc79419d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.301+0000 7fc79259c640 1 --2- 172.21.15.47:0/516258780 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc794102170 0x7fc79419d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc79259c640 1 -- 172.21.15.47:0/516258780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7941077c0 msgr2=0x7fc794197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc79259c640 1 --2- 172.21.15.47:0/516258780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7941077c0 0x7fc794197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc79259c640 1 -- 172.21.15.47:0/516258780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc794197da0 con 0x7fc7941017b0 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc79259c640 1 --2- 172.21.15.47:0/516258780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 0x7fc79419d470 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fc78400e9c0 tx=0x7fc78400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc7837fe640 1 -- 172.21.15.47:0/516258780 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78400ccc0 con 0x7fc7941017b0 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc794198090 con 0x7fc7941017b0 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc7837fe640 1 -- 172.21.15.47:0/516258780 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc7840054d0 con 0x7fc7941017b0 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc7837fe640 1 -- 172.21.15.47:0/516258780 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784010430 con 0x7fc7941017b0 2024-04-06T04:06:44.305 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.302+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7941a4330 con 0x7fc7941017b0 2024-04-06T04:06:44.306 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.303+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc794068b10 con 0x7fc7941017b0 2024-04-06T04:06:44.306 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.303+0000 7fc7837fe640 1 -- 172.21.15.47:0/516258780 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fc784004f40 con 0x7fc7941017b0 2024-04-06T04:06:44.306 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.304+0000 7fc7837fe640 1 --2- 172.21.15.47:0/516258780 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc77c06db70 0x7fc77c070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:06:44.307 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.304+0000 7fc791d9b640 1 --2- 172.21.15.47:0/516258780 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc77c06db70 0x7fc77c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:06:44.307 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.304+0000 7fc7837fe640 1 -- 172.21.15.47:0/516258780 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(758..758 src has 254..758) ==== 7805+0+0 (secure 0 0 0) 0x7fc78408e590 con 0x7fc7941017b0 2024-04-06T04:06:44.307 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.304+0000 7fc791d9b640 1 --2- 172.21.15.47:0/516258780 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc77c06db70 0x7fc77c070030 secure :-1 s=READY pgs=3411 cs=0 l=1 rev1=1 crypto rx=0x7fc788000c00 tx=0x7fc788005890 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:06:44.309 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.309+0000 7fc7837fe640 1 -- 172.21.15.47:0/516258780 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc78405ba70 con 0x7fc7941017b0 2024-04-06T04:06:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[37680]: pgmap v1653: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:06:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[37680]: osdmap e757: 8 total, 8 up, 8 in 2024-04-06T04:06:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:06:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[29365]: pgmap v1653: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:06:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[29365]: osdmap e757: 8 total, 8 up, 8 in 2024-04-06T04:06:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:06:44.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:44 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:44.493 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:44.492+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"} v 0) -- 0x7fc794109d40 con 0x7fc7941017b0 2024-04-06T04:06:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:44 smithi102 ceph-mon[32821]: pgmap v1653: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:06:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:44 smithi102 ceph-mon[32821]: osdmap e757: 8 total, 8 up, 8 in 2024-04-06T04:06:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:44 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:06:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:44 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:45.200 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:45.200+0000 7fc7837fe640 1 -- 172.21.15.47:0/516258780 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]=0 enabled application 'rados' on pool '221d75c7-d61e-469a-8866-a0e9906e6a82' v759) ==== 213+0+0 (secure 0 0 0) 0x7fc78405f4c0 con 0x7fc7941017b0 2024-04-06T04:06:45.317 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:45.317+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"} v 0) -- 0x7fc79402d1b0 con 0x7fc7941017b0 2024-04-06T04:06:45.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:06:45.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:45 smithi047 ceph-mon[29365]: osdmap e758: 8 total, 8 up, 8 in 2024-04-06T04:06:45.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:45 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]: dispatch 2024-04-06T04:06:45.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:06:45.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:45 smithi047 ceph-mon[37680]: osdmap e758: 8 total, 8 up, 8 in 2024-04-06T04:06:45.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:45 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]: dispatch 2024-04-06T04:06:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2074004742' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:06:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:45 smithi102 ceph-mon[32821]: osdmap e758: 8 total, 8 up, 8 in 2024-04-06T04:06:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:45 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]: dispatch 2024-04-06T04:06:46.202 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.202+0000 7fc7837fe640 1 -- 172.21.15.47:0/516258780 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]=0 enabled application 'rados' on pool '221d75c7-d61e-469a-8866-a0e9906e6a82' v760) ==== 213+0+0 (secure 0 0 0) 0x7fc784063cf0 con 0x7fc7941017b0 2024-04-06T04:06:46.203 INFO:tasks.workunit.client.0.smithi047.stderr:enabled application 'rados' on pool '221d75c7-d61e-469a-8866-a0e9906e6a82' 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc77c06db70 msgr2=0x7fc77c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 --2- 172.21.15.47:0/516258780 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc77c06db70 0x7fc77c070030 secure :-1 s=READY pgs=3411 cs=0 l=1 rev1=1 crypto rx=0x7fc788000c00 tx=0x7fc788005890 comp rx=0 tx=0).stop 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 msgr2=0x7fc79419d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 --2- 172.21.15.47:0/516258780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 0x7fc79419d470 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fc78400e9c0 tx=0x7fc78400ee80 comp rx=0 tx=0).stop 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 shutdown_connections 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 --2- 172.21.15.47:0/516258780 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc77c06db70 0x7fc77c070030 unknown :-1 s=CLOSED pgs=3411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 --2- 172.21.15.47:0/516258780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7941077c0 0x7fc794197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 --2- 172.21.15.47:0/516258780 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc794102170 0x7fc79419d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 --2- 172.21.15.47:0/516258780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7941017b0 0x7fc79419d470 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:06:46.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 >> 172.21.15.47:0/516258780 conn(0x7fc7940fd2e0 msgr2=0x7fc7940fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:06:46.208 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 shutdown_connections 2024-04-06T04:06:46.208 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:06:46.206+0000 7fc7988de640 1 -- 172.21.15.47:0/516258780 wait complete. 2024-04-06T04:06:46.218 INFO:tasks.workunit.client.0.smithi047.stderr:++ seq 1 10 2024-04-06T04:06:46.227 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.227 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj1 /etc/passwd 2024-04-06T04:06:46.264 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.264 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj2 /etc/passwd 2024-04-06T04:06:46.301 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.301 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj3 /etc/passwd 2024-04-06T04:06:46.336 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.336 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj4 /etc/passwd 2024-04-06T04:06:46.371 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.372 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj5 /etc/passwd 2024-04-06T04:06:46.409 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.409 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj6 /etc/passwd 2024-04-06T04:06:46.444 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.444 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj7 /etc/passwd 2024-04-06T04:06:46.479 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.479 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj8 /etc/passwd 2024-04-06T04:06:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:46 smithi047 ceph-mon[29365]: pgmap v1656: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]': finished 2024-04-06T04:06:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:46 smithi047 ceph-mon[29365]: osdmap e759: 8 total, 8 up, 8 in 2024-04-06T04:06:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:46 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]: dispatch 2024-04-06T04:06:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:46 smithi047 ceph-mon[37680]: pgmap v1656: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]': finished 2024-04-06T04:06:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:46 smithi047 ceph-mon[37680]: osdmap e759: 8 total, 8 up, 8 in 2024-04-06T04:06:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:46 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]: dispatch 2024-04-06T04:06:46.513 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.513 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj9 /etc/passwd 2024-04-06T04:06:46.548 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:06:46.548 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put obj10 /etc/passwd 2024-04-06T04:06:46.582 INFO:tasks.workunit.client.0.smithi047.stderr:+ sleep 30 2024-04-06T04:06:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:46 smithi102 ceph-mon[32821]: pgmap v1656: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:06:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]': finished 2024-04-06T04:06:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:46 smithi102 ceph-mon[32821]: osdmap e759: 8 total, 8 up, 8 in 2024-04-06T04:06:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:46 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]: dispatch 2024-04-06T04:06:47.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:47 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]': finished 2024-04-06T04:06:47.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:47 smithi047 ceph-mon[29365]: osdmap e760: 8 total, 8 up, 8 in 2024-04-06T04:06:47.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:47 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]': finished 2024-04-06T04:06:47.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:47 smithi047 ceph-mon[37680]: osdmap e760: 8 total, 8 up, 8 in 2024-04-06T04:06:47.582 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:47 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/516258780' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "app": "rados"}]': finished 2024-04-06T04:06:47.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:47 smithi102 ceph-mon[32821]: osdmap e760: 8 total, 8 up, 8 in 2024-04-06T04:06:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:48 smithi047 ceph-mon[29365]: pgmap v1659: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 9.0 KiB/s wr, 1 op/s 2024-04-06T04:06:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:48 smithi047 ceph-mon[29365]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T04:06:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:48 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:06:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:48 smithi047 ceph-mon[37680]: pgmap v1659: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 9.0 KiB/s wr, 1 op/s 2024-04-06T04:06:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:48 smithi047 ceph-mon[37680]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T04:06:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:48 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:06:48.582 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:48 smithi102 ceph-mon[32821]: pgmap v1659: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 9.0 KiB/s wr, 1 op/s 2024-04-06T04:06:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:48 smithi102 ceph-mon[32821]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-06T04:06:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:48 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:06:49.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:06:49.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:06:49.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:06:49.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:06:49.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:06:49.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:06:49.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:06:49.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:06:49.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:06:50.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:50 smithi047 ceph-mon[37680]: pgmap v1660: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 883 B/s rd, 6.2 KiB/s wr, 1 op/s 2024-04-06T04:06:50.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:50.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:50 smithi047 ceph-mon[29365]: pgmap v1660: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 883 B/s rd, 6.2 KiB/s wr, 1 op/s 2024-04-06T04:06:50.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:50.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:50 smithi102 ceph-mon[32821]: pgmap v1660: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 883 B/s rd, 6.2 KiB/s wr, 1 op/s 2024-04-06T04:06:50.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:06:52.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:52 smithi047 ceph-mon[29365]: pgmap v1661: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 753 B/s rd, 5.3 KiB/s wr, 1 op/s 2024-04-06T04:06:52.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:52 smithi047 ceph-mon[37680]: pgmap v1661: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 753 B/s rd, 5.3 KiB/s wr, 1 op/s 2024-04-06T04:06:52.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:52 smithi102 ceph-mon[32821]: pgmap v1661: 176 pgs: 176 active+clean; 617 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 753 B/s rd, 5.3 KiB/s wr, 1 op/s 2024-04-06T04:06:53.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:06:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:06:54.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:06:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:06:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:06:54.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:54 smithi047 ceph-mon[29365]: pgmap v1662: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-04-06T04:06:54.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:54.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:54 smithi047 ceph-mon[37680]: pgmap v1662: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-04-06T04:06:54.743 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:54.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:54 smithi102 ceph-mon[32821]: pgmap v1662: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-04-06T04:06:54.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:06:56.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:56 smithi047 ceph-mon[29365]: pgmap v1663: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 12 KiB/s wr, 2 op/s 2024-04-06T04:06:56.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:56 smithi047 ceph-mon[37680]: pgmap v1663: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 12 KiB/s wr, 2 op/s 2024-04-06T04:06:56.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:56 smithi102 ceph-mon[32821]: pgmap v1663: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 12 KiB/s wr, 2 op/s 2024-04-06T04:06:57.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:57 smithi047 ceph-mon[37680]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' is full (reached quota's max_objects: 10) 2024-04-06T04:06:57.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:57 smithi047 ceph-mon[37680]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:06:57.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:57 smithi047 ceph-mon[37680]: osdmap e761: 8 total, 8 up, 8 in 2024-04-06T04:06:57.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:57 smithi047 ceph-mon[29365]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' is full (reached quota's max_objects: 10) 2024-04-06T04:06:57.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:57 smithi047 ceph-mon[29365]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:06:57.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:57 smithi047 ceph-mon[29365]: osdmap e761: 8 total, 8 up, 8 in 2024-04-06T04:06:57.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:57 smithi102 ceph-mon[32821]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' is full (reached quota's max_objects: 10) 2024-04-06T04:06:57.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:57 smithi102 ceph-mon[32821]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:06:57.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:57 smithi102 ceph-mon[32821]: osdmap e761: 8 total, 8 up, 8 in 2024-04-06T04:06:58.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:06:58 smithi047 ceph-mon[29365]: pgmap v1665: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:06:58.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:06:58 smithi047 ceph-mon[37680]: pgmap v1665: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:06:58.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:06:58 smithi102 ceph-mon[32821]: pgmap v1665: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:07:00.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:00 smithi047 ceph-mon[29365]: pgmap v1666: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:07:00.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:00 smithi047 ceph-mon[37680]: pgmap v1666: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:07:00.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:00 smithi102 ceph-mon[32821]: pgmap v1666: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:07:02.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:02 smithi047 ceph-mon[29365]: pgmap v1667: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:07:02.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:02 smithi047 ceph-mon[37680]: pgmap v1667: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:07:02.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:02 smithi102 ceph-mon[32821]: pgmap v1667: 176 pgs: 176 active+clean; 698 KiB data, 863 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 8.4 KiB/s wr, 1 op/s 2024-04-06T04:07:03.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:07:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:07:04.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:07:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:07:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:07:04.734 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:04 smithi102 ceph-mon[32821]: pgmap v1668: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:04.734 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:04.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:04 smithi047 ceph-mon[29365]: pgmap v1668: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:04.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:04.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:04 smithi047 ceph-mon[37680]: pgmap v1668: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:04.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:05.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:05.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:05.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:05 smithi047 ceph-mon[29365]: pgmap v1669: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:05.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:05.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:05.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:05 smithi047 ceph-mon[37680]: pgmap v1669: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:06.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:06.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:06.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:05 smithi102 ceph-mon[32821]: pgmap v1669: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:08 smithi102 ceph-mon[32821]: pgmap v1670: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-04-06T04:07:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:08 smithi047 ceph-mon[29365]: pgmap v1670: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-04-06T04:07:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:08 smithi047 ceph-mon[37680]: pgmap v1670: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-04-06T04:07:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:10 smithi102 ceph-mon[32821]: pgmap v1671: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:10 smithi047 ceph-mon[29365]: pgmap v1671: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:10 smithi047 ceph-mon[37680]: pgmap v1671: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:12 smithi102 ceph-mon[32821]: pgmap v1672: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:12 smithi047 ceph-mon[29365]: pgmap v1672: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:12 smithi047 ceph-mon[37680]: pgmap v1672: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:13.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:07:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:07:14.054 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:07:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:07:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:07:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:14 smithi102 ceph-mon[32821]: pgmap v1673: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:14 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:14 smithi047 ceph-mon[29365]: pgmap v1673: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:14 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:14.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:14 smithi047 ceph-mon[37680]: pgmap v1673: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:14.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:14 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:16 smithi102 ceph-mon[32821]: pgmap v1674: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:16 smithi047 ceph-mon[29365]: pgmap v1674: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:16.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:16 smithi047 ceph-mon[37680]: pgmap v1674: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:16.584 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=150569 2024-04-06T04:07:16.584 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool set-quota 221d75c7-d61e-469a-8866-a0e9906e6a82 max_objects 100 2024-04-06T04:07:16.584 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put onemore /etc/passwd 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 -- 172.21.15.47:0/1637665497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 msgr2=0x7fc7f0102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/1637665497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 0x7fc7f0102e30 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009900 tx=0x7fc7e802bd60 comp rx=0 tx=0).stop 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 -- 172.21.15.47:0/1637665497 shutdown_connections 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/1637665497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7f010bd90 0x7fc7f010e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/1637665497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7f0103370 0x7fc7f010b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/1637665497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 0x7fc7f0102e30 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 -- 172.21.15.47:0/1637665497 >> 172.21.15.47:0/1637665497 conn(0x7fc7f0077800 msgr2=0x7fc7f0077c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 -- 172.21.15.47:0/1637665497 shutdown_connections 2024-04-06T04:07:16.682 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.679+0000 7fc7f75e0640 1 -- 172.21.15.47:0/1637665497 wait complete. 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f75e0640 1 Processor -- start 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f75e0640 1 -- start start 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f75e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 0x7fc7f019d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f75e0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7f0103370 0x7fc7f019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f75e0640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7f010bd90 0x7fc7f0197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f75e0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f01112a0 con 0x7fc7f0102a50 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f75e0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0111120 con 0x7fc7f0103370 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f75e0640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f0111420 con 0x7fc7f010bd90 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f537c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 0x7fc7f019d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f5b7d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7f010bd90 0x7fc7f0197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f537c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 0x7fc7f019d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47708/0 (socket says 172.21.15.47:47708) 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f537c640 1 -- 172.21.15.47:0/2045093786 learned_addr learned my addr 172.21.15.47:0/2045093786 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f4b7b640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7f0103370 0x7fc7f019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f537c640 1 -- 172.21.15.47:0/2045093786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7f010bd90 msgr2=0x7fc7f0197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:16.683 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f537c640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7f010bd90 0x7fc7f0197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f537c640 1 -- 172.21.15.47:0/2045093786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7f0103370 msgr2=0x7fc7f019d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f537c640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7f0103370 0x7fc7f019d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f537c640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f0197dc0 con 0x7fc7f0102a50 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f5b7d640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7f010bd90 0x7fc7f0197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.680+0000 7fc7f4b7b640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7f0103370 0x7fc7f019d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.681+0000 7fc7f537c640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 0x7fc7f019d440 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8005940 tx=0x7fc7e802c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.681+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8043020 con 0x7fc7f0102a50 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.681+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc7e80043d0 con 0x7fc7f0102a50 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.681+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f0198050 con 0x7fc7f0102a50 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.681+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8003ae0 con 0x7fc7f0102a50 2024-04-06T04:07:16.684 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.681+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f01a4300 con 0x7fc7f0102a50 2024-04-06T04:07:16.685 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.682+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f00686c0 con 0x7fc7f0102a50 2024-04-06T04:07:16.685 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.682+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fc7e8046020 con 0x7fc7f0102a50 2024-04-06T04:07:16.685 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.683+0000 7fc7ee7fc640 1 --2- 172.21.15.47:0/2045093786 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc7d806db70 0x7fc7d8070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:16.685 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.683+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(761..761 src has 254..761) ==== 7818+0+0 (secure 0 0 0) 0x7fc7e80b0400 con 0x7fc7f0102a50 2024-04-06T04:07:16.685 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.683+0000 7fc7f4b7b640 1 --2- 172.21.15.47:0/2045093786 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc7d806db70 0x7fc7d8070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:16.685 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.683+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=762}) -- 0x7fc7d80790d0 con 0x7fc7f0102a50 2024-04-06T04:07:16.686 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.683+0000 7fc7f4b7b640 1 --2- 172.21.15.47:0/2045093786 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc7d806db70 0x7fc7d8070030 secure :-1 s=READY pgs=3423 cs=0 l=1 rev1=1 crypto rx=0x7fc7f010dbb0 tx=0x7fc7e4005f90 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:16.688 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.688+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc7e804d020 con 0x7fc7f0102a50 2024-04-06T04:07:16.873 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:16.873+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"} v 0) -- 0x7fc7f0106f10 con 0x7fc7f0102a50 2024-04-06T04:07:17.062 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:17.061+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v762) ==== 225+0+0 (secure 0 0 0) 0x7fc7e807d8d0 con 0x7fc7f0102a50 2024-04-06T04:07:17.062 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:17.061+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 8 ==== osd_map(762..762 src has 254..762) ==== 628+0+0 (secure 0 0 0) 0x7fc7e80e4280 con 0x7fc7f0102a50 2024-04-06T04:07:17.062 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:17.061+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=763}) -- 0x7fc7d807a030 con 0x7fc7f0102a50 2024-04-06T04:07:17.175 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:17.175+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"} v 0) -- 0x7fc7f0106b20 con 0x7fc7f0102a50 2024-04-06T04:07:17.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:17 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]: dispatch 2024-04-06T04:07:17.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:17 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]: dispatch 2024-04-06T04:07:17.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:17 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]: dispatch 2024-04-06T04:07:18.064 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.063+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v763) ==== 225+0+0 (secure 0 0 0) 0x7fc7e8081320 con 0x7fc7f0102a50 2024-04-06T04:07:18.064 INFO:tasks.workunit.client.0.smithi047.stderr:set-quota max_objects = 100 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 2024-04-06T04:07:18.064 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.063+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 <== mon.0 v2:172.21.15.47:3300/0 10 ==== osd_map(763..763 src has 254..763) ==== 628+0+0 (secure 0 0 0) 0x7fc7e80ae200 con 0x7fc7f0102a50 2024-04-06T04:07:18.064 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.064+0000 7fc7ee7fc640 1 -- 172.21.15.47:0/2045093786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=764}) -- 0x7fc7d807a030 con 0x7fc7f0102a50 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc7d806db70 msgr2=0x7fc7d8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/2045093786 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc7d806db70 0x7fc7d8070030 secure :-1 s=READY pgs=3423 cs=0 l=1 rev1=1 crypto rx=0x7fc7f010dbb0 tx=0x7fc7e4005f90 comp rx=0 tx=0).stop 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 msgr2=0x7fc7f019d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 0x7fc7f019d440 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8005940 tx=0x7fc7e802c900 comp rx=0 tx=0).stop 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 shutdown_connections 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/2045093786 >> v2:172.21.15.47:6800/3359778320 conn(0x7fc7d806db70 0x7fc7d8070030 unknown :-1 s=CLOSED pgs=3423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7f010bd90 0x7fc7f0197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7f0103370 0x7fc7f019d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 --2- 172.21.15.47:0/2045093786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f0102a50 0x7fc7f019d440 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 >> 172.21.15.47:0/2045093786 conn(0x7fc7f0077800 msgr2=0x7fc7f00fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 shutdown_connections 2024-04-06T04:07:18.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:18.071+0000 7fc7f75e0640 1 -- 172.21.15.47:0/2045093786 wait complete. 2024-04-06T04:07:18.084 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 150569 2024-04-06T04:07:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:18 smithi102 ceph-mon[32821]: pgmap v1675: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]': finished 2024-04-06T04:07:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:18 smithi102 ceph-mon[32821]: osdmap e762: 8 total, 8 up, 8 in 2024-04-06T04:07:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:18 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]: dispatch 2024-04-06T04:07:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:18 smithi047 ceph-mon[37680]: pgmap v1675: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]': finished 2024-04-06T04:07:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:18 smithi047 ceph-mon[37680]: osdmap e762: 8 total, 8 up, 8 in 2024-04-06T04:07:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:18 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]: dispatch 2024-04-06T04:07:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:18 smithi047 ceph-mon[29365]: pgmap v1675: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]': finished 2024-04-06T04:07:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:18 smithi047 ceph-mon[29365]: osdmap e762: 8 total, 8 up, 8 in 2024-04-06T04:07:18.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:18 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]: dispatch 2024-04-06T04:07:19.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:19 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]': finished 2024-04-06T04:07:19.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:19 smithi102 ceph-mon[32821]: osdmap e763: 8 total, 8 up, 8 in 2024-04-06T04:07:19.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:19 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]': finished 2024-04-06T04:07:19.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:19 smithi047 ceph-mon[29365]: osdmap e763: 8 total, 8 up, 8 in 2024-04-06T04:07:19.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:19 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2045093786' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "100"}]': finished 2024-04-06T04:07:19.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:19 smithi047 ceph-mon[37680]: osdmap e763: 8 total, 8 up, 8 in 2024-04-06T04:07:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:20 smithi102 ceph-mon[32821]: pgmap v1678: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:20 smithi047 ceph-mon[29365]: pgmap v1678: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:20 smithi047 ceph-mon[37680]: pgmap v1678: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:21.857 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 0 -ne 0 ']' 2024-04-06T04:07:21.857 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-04-06T04:07:21.857 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put twomore /etc/passwd 2024-04-06T04:07:21.895 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool set-quota 221d75c7-d61e-469a-8866-a0e9906e6a82 max_bytes 100 2024-04-06T04:07:21.983 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 -- 172.21.15.47:0/2773079710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1006c0 msgr2=0x7f975c100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:21.983 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 --2- 172.21.15.47:0/2773079710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1006c0 0x7f975c100b40 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f9744009930 tx=0x7f974402bc30 comp rx=0 tx=0).stop 2024-04-06T04:07:21.983 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 -- 172.21.15.47:0/2773079710 shutdown_connections 2024-04-06T04:07:21.983 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 --2- 172.21.15.47:0/2773079710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f975c101080 0x7f975c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:21.983 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 --2- 172.21.15.47:0/2773079710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1006c0 0x7f975c100b40 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:21.983 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 --2- 172.21.15.47:0/2773079710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c1066d0 0x7f975c106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 -- 172.21.15.47:0/2773079710 >> 172.21.15.47:0/2773079710 conn(0x7f975c0778c0 msgr2=0x7f975c077cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 -- 172.21.15.47:0/2773079710 shutdown_connections 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 -- 172.21.15.47:0/2773079710 wait complete. 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.981+0000 7f9760f1e640 1 Processor -- start 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9760f1e640 1 -- start start 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9760f1e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f975c1006c0 0x7f975c19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9760f1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c101080 0x7f975c19d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9760f1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1066d0 0x7f975c1975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9760f1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f975c1112f0 con 0x7f975c1066d0 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9760f1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f975c111170 con 0x7f975c101080 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9760f1e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f975c111470 con 0x7f975c1006c0 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975a59c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f975c1006c0 0x7f975c19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1066d0 0x7f975c1975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:21.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975a59c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f975c1006c0 0x7f975c19d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:60144/0 (socket says 172.21.15.47:60144) 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1066d0 0x7f975c1975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47760/0 (socket says 172.21.15.47:47760) 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975a59c640 1 -- 172.21.15.47:0/3703631944 learned_addr learned my addr 172.21.15.47:0/3703631944 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9753fff640 1 --2- 172.21.15.47:0/3703631944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c101080 0x7f975c19d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975ad9d640 1 -- 172.21.15.47:0/3703631944 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f975c1006c0 msgr2=0x7f975c19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975ad9d640 1 --2- 172.21.15.47:0/3703631944 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f975c1006c0 0x7f975c19d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975ad9d640 1 -- 172.21.15.47:0/3703631944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c101080 msgr2=0x7f975c19d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975ad9d640 1 --2- 172.21.15.47:0/3703631944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c101080 0x7f975c19d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975ad9d640 1 -- 172.21.15.47:0/3703631944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c197d50 con 0x7f975c1066d0 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f975ad9d640 1 --2- 172.21.15.47:0/3703631944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1066d0 0x7f975c1975d0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f975400ec50 tx=0x7f975400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f97537fe640 1 -- 172.21.15.47:0/3703631944 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754003b70 con 0x7f975c1066d0 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c198040 con 0x7f975c1066d0 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f97537fe640 1 -- 172.21.15.47:0/3703631944 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f9754003d10 con 0x7f975c1066d0 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.982+0000 7f97537fe640 1 -- 172.21.15.47:0/3703631944 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97540107b0 con 0x7f975c1066d0 2024-04-06T04:07:21.985 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.983+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c1a42e0 con 0x7f975c1066d0 2024-04-06T04:07:21.986 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.984+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c068b10 con 0x7f975c1066d0 2024-04-06T04:07:21.986 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.984+0000 7f97537fe640 1 -- 172.21.15.47:0/3703631944 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f9754003fc0 con 0x7f975c1066d0 2024-04-06T04:07:21.986 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.984+0000 7f97537fe640 1 --2- 172.21.15.47:0/3703631944 >> v2:172.21.15.47:6800/3359778320 conn(0x7f974806db70 0x7f9748070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:21.987 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.984+0000 7f97537fe640 1 -- 172.21.15.47:0/3703631944 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(764..764 src has 254..764) ==== 7818+0+0 (secure 0 0 0) 0x7f975408e790 con 0x7f975c1066d0 2024-04-06T04:07:21.987 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.984+0000 7f975a59c640 1 --2- 172.21.15.47:0/3703631944 >> v2:172.21.15.47:6800/3359778320 conn(0x7f974806db70 0x7f9748070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:21.987 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.985+0000 7f975a59c640 1 --2- 172.21.15.47:0/3703631944 >> v2:172.21.15.47:6800/3359778320 conn(0x7f974806db70 0x7f9748070030 secure :-1 s=READY pgs=3425 cs=0 l=1 rev1=1 crypto rx=0x7f974c00ac10 tx=0x7f974c00a380 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:21.989 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:21.989+0000 7f97537fe640 1 -- 172.21.15.47:0/3703631944 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f975405f6b0 con 0x7f975c1066d0 2024-04-06T04:07:22.176 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:22.175+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"} v 0) -- 0x7f975c108c30 con 0x7f975c1066d0 2024-04-06T04:07:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:22 smithi047 ceph-mon[29365]: pgmap v1679: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T04:07:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:22 smithi047 ceph-mon[29365]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' no longer out of quota; removing NO_QUOTA flag 2024-04-06T04:07:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:22 smithi047 ceph-mon[29365]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:07:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:22 smithi047 ceph-mon[29365]: osdmap e764: 8 total, 8 up, 8 in 2024-04-06T04:07:22.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:22 smithi047 ceph-mon[37680]: pgmap v1679: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T04:07:22.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:22 smithi047 ceph-mon[37680]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' no longer out of quota; removing NO_QUOTA flag 2024-04-06T04:07:22.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:22 smithi047 ceph-mon[37680]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:07:22.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:22 smithi047 ceph-mon[37680]: osdmap e764: 8 total, 8 up, 8 in 2024-04-06T04:07:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:22 smithi102 ceph-mon[32821]: pgmap v1679: 176 pgs: 176 active+clean; 698 KiB data, 859 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T04:07:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:22 smithi102 ceph-mon[32821]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' no longer out of quota; removing NO_QUOTA flag 2024-04-06T04:07:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:22 smithi102 ceph-mon[32821]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:07:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:22 smithi102 ceph-mon[32821]: osdmap e764: 8 total, 8 up, 8 in 2024-04-06T04:07:23.089 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:23.088+0000 7f97537fe640 1 -- 172.21.15.47:0/3703631944 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v765) ==== 221+0+0 (secure 0 0 0) 0x7f9754063ee0 con 0x7f975c1066d0 2024-04-06T04:07:23.210 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:23.209+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"} v 0) -- 0x7f975c1086a0 con 0x7f975c1066d0 2024-04-06T04:07:23.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:23 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-06T04:07:23.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:23 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-06T04:07:23.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:23 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-06T04:07:23.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:07:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:07:24.091 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.090+0000 7f97537fe640 1 -- 172.21.15.47:0/3703631944 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v766) ==== 221+0+0 (secure 0 0 0) 0x7f975408c590 con 0x7f975c1066d0 2024-04-06T04:07:24.091 INFO:tasks.workunit.client.0.smithi047.stderr:set-quota max_bytes = 100 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 2024-04-06T04:07:24.095 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 >> v2:172.21.15.47:6800/3359778320 conn(0x7f974806db70 msgr2=0x7f9748070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:24.095 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 --2- 172.21.15.47:0/3703631944 >> v2:172.21.15.47:6800/3359778320 conn(0x7f974806db70 0x7f9748070030 secure :-1 s=READY pgs=3425 cs=0 l=1 rev1=1 crypto rx=0x7f974c00ac10 tx=0x7f974c00a380 comp rx=0 tx=0).stop 2024-04-06T04:07:24.095 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1066d0 msgr2=0x7f975c1975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:24.095 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 --2- 172.21.15.47:0/3703631944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1066d0 0x7f975c1975d0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f975400ec50 tx=0x7f975400c6a0 comp rx=0 tx=0).stop 2024-04-06T04:07:24.095 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 shutdown_connections 2024-04-06T04:07:24.096 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 --2- 172.21.15.47:0/3703631944 >> v2:172.21.15.47:6800/3359778320 conn(0x7f974806db70 0x7f9748070030 unknown :-1 s=CLOSED pgs=3425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:24.096 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 --2- 172.21.15.47:0/3703631944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f975c1066d0 0x7f975c1975d0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:24.096 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 --2- 172.21.15.47:0/3703631944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c101080 0x7f975c19d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:24.096 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 --2- 172.21.15.47:0/3703631944 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f975c1006c0 0x7f975c19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:24.096 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.094+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 >> 172.21.15.47:0/3703631944 conn(0x7f975c0778c0 msgr2=0x7f975c103230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:24.096 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.095+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 shutdown_connections 2024-04-06T04:07:24.096 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:24.095+0000 7f9760f1e640 1 -- 172.21.15.47:0/3703631944 wait complete. 2024-04-06T04:07:24.101 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:07:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:07:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:07:24.114 INFO:tasks.workunit.client.0.smithi047.stderr:+ sleep 30 2024-04-06T04:07:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[29365]: pgmap v1681: 176 pgs: 176 active+clean; 698 KiB data, 855 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]': finished 2024-04-06T04:07:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[29365]: osdmap e765: 8 total, 8 up, 8 in 2024-04-06T04:07:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-06T04:07:24.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[37680]: pgmap v1681: 176 pgs: 176 active+clean; 698 KiB data, 855 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]': finished 2024-04-06T04:07:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[37680]: osdmap e765: 8 total, 8 up, 8 in 2024-04-06T04:07:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-06T04:07:24.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:24 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:24 smithi102 ceph-mon[32821]: pgmap v1681: 176 pgs: 176 active+clean; 698 KiB data, 855 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]': finished 2024-04-06T04:07:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:24 smithi102 ceph-mon[32821]: osdmap e765: 8 total, 8 up, 8 in 2024-04-06T04:07:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:24 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-06T04:07:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:24 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:25.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:25 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]': finished 2024-04-06T04:07:25.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:25 smithi047 ceph-mon[29365]: osdmap e766: 8 total, 8 up, 8 in 2024-04-06T04:07:25.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:25 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]': finished 2024-04-06T04:07:25.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:25 smithi047 ceph-mon[37680]: osdmap e766: 8 total, 8 up, 8 in 2024-04-06T04:07:25.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:25 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3703631944' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "100"}]': finished 2024-04-06T04:07:25.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:25 smithi102 ceph-mon[32821]: osdmap e766: 8 total, 8 up, 8 in 2024-04-06T04:07:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:26 smithi047 ceph-mon[29365]: pgmap v1684: 176 pgs: 176 active+clean; 698 KiB data, 855 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:26.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:26 smithi047 ceph-mon[37680]: pgmap v1684: 176 pgs: 176 active+clean; 698 KiB data, 855 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:26 smithi102 ceph-mon[32821]: pgmap v1684: 176 pgs: 176 active+clean; 698 KiB data, 855 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:27.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:27 smithi047 ceph-mon[29365]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' is full (reached quota's max_bytes: 100 B) 2024-04-06T04:07:27.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:27 smithi047 ceph-mon[29365]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:07:27.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:27 smithi047 ceph-mon[29365]: osdmap e767: 8 total, 8 up, 8 in 2024-04-06T04:07:27.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:27 smithi047 ceph-mon[37680]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' is full (reached quota's max_bytes: 100 B) 2024-04-06T04:07:27.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:27 smithi047 ceph-mon[37680]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:07:27.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:27 smithi047 ceph-mon[37680]: osdmap e767: 8 total, 8 up, 8 in 2024-04-06T04:07:27.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:27 smithi102 ceph-mon[32821]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' is full (reached quota's max_bytes: 100 B) 2024-04-06T04:07:27.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:27 smithi102 ceph-mon[32821]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:07:27.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:27 smithi102 ceph-mon[32821]: osdmap e767: 8 total, 8 up, 8 in 2024-04-06T04:07:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:28 smithi047 ceph-mon[29365]: pgmap v1686: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 993 B/s rd, 4.7 KiB/s wr, 1 op/s 2024-04-06T04:07:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:28 smithi047 ceph-mon[37680]: pgmap v1686: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 993 B/s rd, 4.7 KiB/s wr, 1 op/s 2024-04-06T04:07:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:28 smithi102 ceph-mon[32821]: pgmap v1686: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 993 B/s rd, 4.7 KiB/s wr, 1 op/s 2024-04-06T04:07:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:30 smithi047 ceph-mon[29365]: pgmap v1687: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-06T04:07:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:30 smithi047 ceph-mon[37680]: pgmap v1687: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-06T04:07:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:30 smithi102 ceph-mon[32821]: pgmap v1687: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-06T04:07:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:32 smithi047 ceph-mon[29365]: pgmap v1688: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 647 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-04-06T04:07:32.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:32 smithi047 ceph-mon[37680]: pgmap v1688: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 647 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-04-06T04:07:32.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:32 smithi102 ceph-mon[32821]: pgmap v1688: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 647 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-04-06T04:07:33.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:07:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:07:34.117 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:07:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:07:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:07:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:34 smithi047 ceph-mon[29365]: pgmap v1689: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-04-06T04:07:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:34 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:34 smithi047 ceph-mon[37680]: pgmap v1689: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-04-06T04:07:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:34 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:34 smithi102 ceph-mon[32821]: pgmap v1689: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2024-04-06T04:07:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:34 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:36 smithi047 ceph-mon[29365]: pgmap v1690: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-04-06T04:07:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:36 smithi047 ceph-mon[37680]: pgmap v1690: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-04-06T04:07:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:36 smithi102 ceph-mon[32821]: pgmap v1690: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-04-06T04:07:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:38 smithi047 ceph-mon[29365]: pgmap v1691: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-04-06T04:07:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:38 smithi047 ceph-mon[37680]: pgmap v1691: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-04-06T04:07:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:38 smithi102 ceph-mon[32821]: pgmap v1691: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-04-06T04:07:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:40 smithi047 ceph-mon[29365]: pgmap v1692: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:40.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:40 smithi047 ceph-mon[37680]: pgmap v1692: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:40.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:40 smithi102 ceph-mon[32821]: pgmap v1692: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:42 smithi047 ceph-mon[29365]: pgmap v1693: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:42.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:42 smithi047 ceph-mon[37680]: pgmap v1693: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:42 smithi102 ceph-mon[32821]: pgmap v1693: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:43.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:07:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:07:44.135 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:07:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:07:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:07:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:44 smithi047 ceph-mon[29365]: pgmap v1694: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:44 smithi047 ceph-mon[37680]: pgmap v1694: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:44 smithi102 ceph-mon[32821]: pgmap v1694: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:45.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:45 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:45.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:45 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:45 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:46 smithi047 ceph-mon[29365]: pgmap v1695: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:46 smithi047 ceph-mon[37680]: pgmap v1695: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:46 smithi102 ceph-mon[32821]: pgmap v1695: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:48 smithi047 ceph-mon[29365]: pgmap v1696: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:48 smithi047 ceph-mon[37680]: pgmap v1696: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:48 smithi102 ceph-mon[32821]: pgmap v1696: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:49.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:49 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:07:49.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:49 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:07:49.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:49 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:07:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:50 smithi102 ceph-mon[32821]: pgmap v1697: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:07:50.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:50.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:50 smithi047 ceph-mon[29365]: pgmap v1697: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:07:50.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:50.475 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:50 smithi047 ceph-mon[37680]: pgmap v1697: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:07:50.475 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:07:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:52 smithi047 ceph-mon[29365]: pgmap v1698: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:52 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:52 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:52.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:52 smithi047 ceph-mon[37680]: pgmap v1698: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:52.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:52 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:52.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:52 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:52 smithi102 ceph-mon[32821]: pgmap v1698: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:07:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:52 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:52 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:07:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:07:53.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:53 smithi102 ceph-mon[32821]: pgmap v1699: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:53.833 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:07:53.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:07:53.834 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:53 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.992 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:07:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[37680]: pgmap v1699: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:53.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[29365]: pgmap v1699: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:53.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:07:53.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:07:53.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:53 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:07:54.115 INFO:tasks.workunit.client.0.smithi047.stderr:+ pid=151235 2024-04-06T04:07:54.116 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool set-quota 221d75c7-d61e-469a-8866-a0e9906e6a82 max_bytes 0 2024-04-06T04:07:54.116 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put two /etc/passwd 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 -- 172.21.15.47:0/3161428208 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 msgr2=0x7f6c6c10dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 --2- 172.21.15.47:0/3161428208 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 0x7f6c6c10dc40 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009ca0 tx=0x7f6c6002c100 comp rx=0 tx=0).stop 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 -- 172.21.15.47:0/3161428208 shutdown_connections 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 --2- 172.21.15.47:0/3161428208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c6c10e180 0x7f6c6c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 --2- 172.21.15.47:0/3161428208 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 0x7f6c6c10dc40 unknown :-1 s=CLOSED pgs=2555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 --2- 172.21.15.47:0/3161428208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c6c1005d0 0x7f6c6c1009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 -- 172.21.15.47:0/3161428208 >> 172.21.15.47:0/3161428208 conn(0x7f6c6c0778c0 msgr2=0x7f6c6c077cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 -- 172.21.15.47:0/3161428208 shutdown_connections 2024-04-06T04:07:54.215 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.211+0000 7f6c73ede640 1 -- 172.21.15.47:0/3161428208 wait complete. 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c73ede640 1 Processor -- start 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c73ede640 1 -- start start 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c73ede640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c6c1005d0 0x7f6c6c19f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c73ede640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 0x7f6c6c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c73ede640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c6c10e180 0x7f6c6c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c73ede640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c1134f0 con 0x7f6c6c1005d0 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c73ede640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c113370 con 0x7f6c6c10e180 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c73ede640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c113670 con 0x7f6c6c100ef0 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71479640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 0x7f6c6c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71c7a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c6c1005d0 0x7f6c6c19f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71479640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 0x7f6c6c19fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:48488/0 (socket says 172.21.15.47:48488) 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71479640 1 -- 172.21.15.47:0/1702149418 learned_addr learned my addr 172.21.15.47:0/1702149418 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:07:54.216 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c7247b640 1 --2- 172.21.15.47:0/1702149418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c6c10e180 0x7f6c6c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71479640 1 -- 172.21.15.47:0/1702149418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c6c10e180 msgr2=0x7f6c6c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71479640 1 --2- 172.21.15.47:0/1702149418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c6c10e180 0x7f6c6c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71479640 1 -- 172.21.15.47:0/1702149418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c6c1005d0 msgr2=0x7f6c6c19f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71479640 1 --2- 172.21.15.47:0/1702149418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c6c1005d0 0x7f6c6c19f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.212+0000 7f6c71479640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c199fb0 con 0x7f6c6c100ef0 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.213+0000 7f6c71479640 1 --2- 172.21.15.47:0/1702149418 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 0x7f6c6c19fbb0 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7f6c60005e30 tx=0x7f6c600328f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.213+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60041020 con 0x7f6c6c100ef0 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.213+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f6c60003e20 con 0x7f6c6c100ef0 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.213+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c19a240 con 0x7f6c6c100ef0 2024-04-06T04:07:54.217 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.213+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60039040 con 0x7f6c6c100ef0 2024-04-06T04:07:54.218 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.213+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c1a64c0 con 0x7f6c6c100ef0 2024-04-06T04:07:54.218 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.214+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6c06a700 con 0x7f6c6c100ef0 2024-04-06T04:07:54.218 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.214+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f6c60044020 con 0x7f6c6c100ef0 2024-04-06T04:07:54.219 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.215+0000 7f6c5effd640 1 --2- 172.21.15.47:0/1702149418 >> v2:172.21.15.47:6800/3359778320 conn(0x7f6c5806db70 0x7f6c58070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:54.219 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.215+0000 7f6c71c7a640 1 --2- 172.21.15.47:0/1702149418 >> v2:172.21.15.47:6800/3359778320 conn(0x7f6c5806db70 0x7f6c58070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:54.219 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.215+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(767..767 src has 254..767) ==== 7818+0+0 (secure 0 0 0) 0x7f6c600b0320 con 0x7f6c6c100ef0 2024-04-06T04:07:54.219 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.215+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=768}) -- 0x7f6c580790d0 con 0x7f6c6c100ef0 2024-04-06T04:07:54.219 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.215+0000 7f6c71c7a640 1 --2- 172.21.15.47:0/1702149418 >> v2:172.21.15.47:6800/3359778320 conn(0x7f6c5806db70 0x7f6c58070030 secure :-1 s=READY pgs=3427 cs=0 l=1 rev1=1 crypto rx=0x7f6c680095f0 tx=0x7f6c68005f90 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:54.220 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.220+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6c6004b020 con 0x7f6c6c100ef0 2024-04-06T04:07:54.404 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.403+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"} v 0) -- 0x7f6c6c19ad10 con 0x7f6c6c100ef0 2024-04-06T04:07:54.604 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.603+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 7 ==== osd_map(768..768 src has 254..768) ==== 628+0+0 (secure 0 0 0) 0x7f6c600e4280 con 0x7f6c6c100ef0 2024-04-06T04:07:54.604 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.603+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=769}) -- 0x7f6c58079c40 con 0x7f6c6c100ef0 2024-04-06T04:07:54.607 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.607+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v768) ==== 217+0+0 (secure 0 0 0) 0x7f6c6007d870 con 0x7f6c6c100ef0 2024-04-06T04:07:54.719 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:54.719+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"} v 0) -- 0x7f6c6c1a6690 con 0x7f6c6c100ef0 2024-04-06T04:07:54.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:54 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:54.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:54 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1702149418' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:54.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:54 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:54.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:54 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:54.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:54 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1702149418' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:54.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:54 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:55.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:54 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:07:55.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:54 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1702149418' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:55.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:54 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:55.609 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.608+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 9 ==== osd_map(769..769 src has 254..769) ==== 628+0+0 (secure 0 0 0) 0x7f6c60009890 con 0x7f6c6c100ef0 2024-04-06T04:07:55.609 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.608+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=770}) -- 0x7f6c5807a030 con 0x7f6c6c100ef0 2024-04-06T04:07:55.614 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.613+0000 7f6c5effd640 1 -- 172.21.15.47:0/1702149418 <== mon.2 v2:172.21.15.47:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v769) ==== 217+0+0 (secure 0 0 0) 0x7f6c600812c0 con 0x7f6c6c100ef0 2024-04-06T04:07:55.614 INFO:tasks.workunit.client.0.smithi047.stderr:set-quota max_bytes = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 >> v2:172.21.15.47:6800/3359778320 conn(0x7f6c5806db70 msgr2=0x7f6c58070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 --2- 172.21.15.47:0/1702149418 >> v2:172.21.15.47:6800/3359778320 conn(0x7f6c5806db70 0x7f6c58070030 secure :-1 s=READY pgs=3427 cs=0 l=1 rev1=1 crypto rx=0x7f6c680095f0 tx=0x7f6c68005f90 comp rx=0 tx=0).stop 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 msgr2=0x7f6c6c19fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 --2- 172.21.15.47:0/1702149418 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 0x7f6c6c19fbb0 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7f6c60005e30 tx=0x7f6c600328f0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 shutdown_connections 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 --2- 172.21.15.47:0/1702149418 >> v2:172.21.15.47:6800/3359778320 conn(0x7f6c5806db70 0x7f6c58070030 unknown :-1 s=CLOSED pgs=3427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 --2- 172.21.15.47:0/1702149418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c6c10e180 0x7f6c6c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 --2- 172.21.15.47:0/1702149418 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6c6c100ef0 0x7f6c6c19fbb0 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 --2- 172.21.15.47:0/1702149418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c6c1005d0 0x7f6c6c19f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 >> 172.21.15.47:0/1702149418 conn(0x7f6c6c0778c0 msgr2=0x7f6c6c0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:55.618 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 shutdown_connections 2024-04-06T04:07:55.619 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.617+0000 7f6c73ede640 1 -- 172.21.15.47:0/1702149418 wait complete. 2024-04-06T04:07:55.628 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool set-quota 221d75c7-d61e-469a-8866-a0e9906e6a82 max_objects 0 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.717+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/2892511714 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a341066d0 msgr2=0x7f4a34106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.717+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/2892511714 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a341066d0 0x7f4a34106ab0 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009cd0 tx=0x7f4a2c02c0f0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.717+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/2892511714 shutdown_connections 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.717+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/2892511714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a34101080 0x7f4a3410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.717+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/2892511714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a341006c0 0x7f4a34100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.717+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/2892511714 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a341066d0 0x7f4a34106ab0 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.717+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/2892511714 >> 172.21.15.47:0/2892511714 conn(0x7f4a340777d0 msgr2=0x7f4a34077be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.717+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/2892511714 shutdown_connections 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/2892511714 wait complete. 2024-04-06T04:07:55.724 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 Processor -- start 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 -- start start 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a341006c0 0x7f4a3419d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a34101080 0x7f4a3419db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a341066d0 0x7f4a34197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a341101f0 con 0x7f4a341006c0 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4a34110070 con 0x7f4a341066d0 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a3ab7b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f4a34110370 con 0x7f4a34101080 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a38917640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a341006c0 0x7f4a3419d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a34101080 0x7f4a3419db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a38917640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a341006c0 0x7f4a3419d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60034/0 (socket says 172.21.15.47:60034) 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.718+0000 7f4a38917640 1 -- 172.21.15.47:0/640420995 learned_addr learned my addr 172.21.15.47:0/640420995 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a38917640 1 -- 172.21.15.47:0/640420995 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a34101080 msgr2=0x7f4a3419db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a38917640 1 --2- 172.21.15.47:0/640420995 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a34101080 0x7f4a3419db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.725 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a38917640 1 -- 172.21.15.47:0/640420995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a341066d0 msgr2=0x7f4a34197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a38917640 1 --2- 172.21.15.47:0/640420995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a341066d0 0x7f4a34197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a38917640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a34197f40 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a33fff640 1 --2- 172.21.15.47:0/640420995 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a34101080 0x7f4a3419db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a38917640 1 --2- 172.21.15.47:0/640420995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a341006c0 0x7f4a3419d5c0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c02c700 tx=0x7f4a2c032870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c041020 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a341981d0 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f4a2c032460 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c039040 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.719+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a341a4540 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.720+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a34101e00 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.721+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f4a2c044020 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.721+0000 7f4a31ffb640 1 --2- 172.21.15.47:0/640420995 >> v2:172.21.15.47:6800/3359778320 conn(0x7f4a1c06db70 0x7f4a1c070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.721+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(769..769 src has 254..769) ==== 7818+0+0 (secure 0 0 0) 0x7f4a2c0b0120 con 0x7f4a341006c0 2024-04-06T04:07:55.726 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.721+0000 7f4a33fff640 1 --2- 172.21.15.47:0/640420995 >> v2:172.21.15.47:6800/3359778320 conn(0x7f4a1c06db70 0x7f4a1c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:55.727 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.721+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=770}) -- 0x7f4a1c0790d0 con 0x7f4a341006c0 2024-04-06T04:07:55.727 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.722+0000 7f4a33fff640 1 --2- 172.21.15.47:0/640420995 >> v2:172.21.15.47:6800/3359778320 conn(0x7f4a1c06db70 0x7f4a1c070030 secure :-1 s=READY pgs=3428 cs=0 l=1 rev1=1 crypto rx=0x7f4a34198ed0 tx=0x7f4a2800a250 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:55.727 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.726+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4a2c04b020 con 0x7f4a341006c0 2024-04-06T04:07:55.908 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:55.908+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"} v 0) -- 0x7f4a34198bb0 con 0x7f4a341006c0 2024-04-06T04:07:55.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:07:55.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[29365]: osdmap e768: 8 total, 8 up, 8 in 2024-04-06T04:07:55.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1702149418' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:55.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:55.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[29365]: pgmap v1701: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:07:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[37680]: osdmap e768: 8 total, 8 up, 8 in 2024-04-06T04:07:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1702149418' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:55.993 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:55 smithi047 ceph-mon[37680]: pgmap v1701: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:56.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:07:56.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:55 smithi102 ceph-mon[32821]: osdmap e768: 8 total, 8 up, 8 in 2024-04-06T04:07:56.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:55 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1702149418' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:56.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:55 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:07:56.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:55 smithi102 ceph-mon[32821]: pgmap v1701: 176 pgs: 176 active+clean; 721 KiB data, 851 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:07:56.610 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.609+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v770) ==== 221+0+0 (secure 0 0 0) 0x7f4a2c07d5f0 con 0x7f4a341006c0 2024-04-06T04:07:56.610 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.610+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 8 ==== osd_map(770..770 src has 254..770) ==== 628+0+0 (secure 0 0 0) 0x7f4a2c0e4280 con 0x7f4a341006c0 2024-04-06T04:07:56.610 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.610+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=771}) -- 0x7f4a1c079f50 con 0x7f4a341006c0 2024-04-06T04:07:56.728 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.727+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"} v 0) -- 0x7f4a341a4710 con 0x7f4a341006c0 2024-04-06T04:07:56.852 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.851+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v771) ==== 221+0+0 (secure 0 0 0) 0x7f4a2c081040 con 0x7f4a341006c0 2024-04-06T04:07:56.852 INFO:tasks.workunit.client.0.smithi047.stderr:set-quota max_objects = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 2024-04-06T04:07:56.852 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.851+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 <== mon.0 v2:172.21.15.47:3300/0 10 ==== osd_map(771..771 src has 254..771) ==== 628+0+0 (secure 0 0 0) 0x7f4a2c083020 con 0x7f4a341006c0 2024-04-06T04:07:56.852 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.851+0000 7f4a31ffb640 1 -- 172.21.15.47:0/640420995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=772}) -- 0x7f4a1c07a070 con 0x7f4a341006c0 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.854+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 >> v2:172.21.15.47:6800/3359778320 conn(0x7f4a1c06db70 msgr2=0x7f4a1c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/640420995 >> v2:172.21.15.47:6800/3359778320 conn(0x7f4a1c06db70 0x7f4a1c070030 secure :-1 s=READY pgs=3428 cs=0 l=1 rev1=1 crypto rx=0x7f4a34198ed0 tx=0x7f4a2800a250 comp rx=0 tx=0).stop 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a341006c0 msgr2=0x7f4a3419d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/640420995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a341006c0 0x7f4a3419d5c0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c02c700 tx=0x7f4a2c032870 comp rx=0 tx=0).stop 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 shutdown_connections 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/640420995 >> v2:172.21.15.47:6800/3359778320 conn(0x7f4a1c06db70 0x7f4a1c070030 unknown :-1 s=CLOSED pgs=3428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/640420995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a341066d0 0x7f4a34197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/640420995 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4a34101080 0x7f4a3419db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 --2- 172.21.15.47:0/640420995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a341006c0 0x7f4a3419d5c0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.856 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 >> 172.21.15.47:0/640420995 conn(0x7f4a340777d0 msgr2=0x7f4a340ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:56.857 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 shutdown_connections 2024-04-06T04:07:56.857 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.855+0000 7f4a3ab7b640 1 -- 172.21.15.47:0/640420995 wait complete. 2024-04-06T04:07:56.867 INFO:tasks.workunit.client.0.smithi047.stderr:+ wait 151235 2024-04-06T04:07:56.867 INFO:tasks.workunit.client.0.smithi047.stderr:+ '[' 0 -ne 0 ']' 2024-04-06T04:07:56.868 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-04-06T04:07:56.868 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put three /etc/passwd 2024-04-06T04:07:56.903 INFO:tasks.workunit.client.0.smithi047.stderr:++ uuidgen 2024-04-06T04:07:56.904 INFO:tasks.workunit.client.0.smithi047.stderr:+ pp=432b0d4c-0aa7-47da-b6b8-69d933cee88c 2024-04-06T04:07:56.905 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool create 432b0d4c-0aa7-47da-b6b8-69d933cee88c 12 2024-04-06T04:07:56.990 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 -- 172.21.15.47:0/3052170391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100b10 msgr2=0x7fe58410e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:56.990 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 --2- 172.21.15.47:0/3052170391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100b10 0x7fe58410e6a0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009be0 tx=0x7fe57c02bef0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.990 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 -- 172.21.15.47:0/3052170391 shutdown_connections 2024-04-06T04:07:56.990 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 --2- 172.21.15.47:0/3052170391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100b10 0x7fe58410e6a0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.990 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 --2- 172.21.15.47:0/3052170391 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe584100150 0x7fe5841005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.990 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 --2- 172.21.15.47:0/3052170391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe584106830 0x7fe584106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.990 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 -- 172.21.15.47:0/3052170391 >> 172.21.15.47:0/3052170391 conn(0x7fe5840759c0 msgr2=0x7fe584075dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:56.990 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 -- 172.21.15.47:0/3052170391 shutdown_connections 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.987+0000 7fe589ab0640 1 -- 172.21.15.47:0/3052170391 wait complete. 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe589ab0640 1 Processor -- start 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe589ab0640 1 -- start start 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe589ab0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100150 0x7fe5841976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe589ab0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe584100b10 0x7fe584197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe589ab0640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe584106830 0x7fe58419bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe589ab0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841112d0 con 0x7fe584100150 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe589ab0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe584111150 con 0x7fe584100b10 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe589ab0640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe584111450 con 0x7fe584106830 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe5837fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100150 0x7fe5841976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe583fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe584106830 0x7fe58419bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe5837fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100150 0x7fe5841976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59666/0 (socket says 172.21.15.47:59666) 2024-04-06T04:07:56.991 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe5837fe640 1 -- 172.21.15.47:0/1277580333 learned_addr learned my addr 172.21.15.47:0/1277580333 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe582ffd640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe584100b10 0x7fe584197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe583fff640 1 -- 172.21.15.47:0/1277580333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe584100b10 msgr2=0x7fe584197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe583fff640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe584100b10 0x7fe584197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe583fff640 1 -- 172.21.15.47:0/1277580333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100150 msgr2=0x7fe5841976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe583fff640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100150 0x7fe5841976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe583fff640 1 -- 172.21.15.47:0/1277580333 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58419c690 con 0x7fe584106830 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.988+0000 7fe5837fe640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100150 0x7fe5841976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.989+0000 7fe583fff640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe584106830 0x7fe58419bf60 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7fe57c02c430 tx=0x7fe57c033cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.989+0000 7fe580ff9640 1 -- 172.21.15.47:0/1277580333 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c043020 con 0x7fe584106830 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.989+0000 7fe580ff9640 1 -- 172.21.15.47:0/1277580333 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe57c02ca60 con 0x7fe584106830 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.989+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58419c920 con 0x7fe584106830 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.989+0000 7fe580ff9640 1 -- 172.21.15.47:0/1277580333 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c034430 con 0x7fe584106830 2024-04-06T04:07:56.992 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.989+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5841a4210 con 0x7fe584106830 2024-04-06T04:07:56.993 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.990+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe584068b10 con 0x7fe584106830 2024-04-06T04:07:56.993 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.990+0000 7fe580ff9640 1 -- 172.21.15.47:0/1277580333 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fe57c046020 con 0x7fe584106830 2024-04-06T04:07:56.993 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.991+0000 7fe580ff9640 1 --2- 172.21.15.47:0/1277580333 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe56c06db70 0x7fe56c070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:56.994 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.991+0000 7fe5837fe640 1 --2- 172.21.15.47:0/1277580333 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe56c06db70 0x7fe56c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:56.994 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.991+0000 7fe580ff9640 1 -- 172.21.15.47:0/1277580333 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(771..771 src has 254..771) ==== 7818+0+0 (secure 0 0 0) 0x7fe57c0b0760 con 0x7fe584106830 2024-04-06T04:07:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:56 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:07:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:56 smithi047 ceph-mon[29365]: osdmap e769: 8 total, 8 up, 8 in 2024-04-06T04:07:56.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:56 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:07:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:56 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:07:56.994 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:56 smithi047 ceph-mon[37680]: osdmap e769: 8 total, 8 up, 8 in 2024-04-06T04:07:56.995 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:56 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:07:56.995 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.991+0000 7fe5837fe640 1 --2- 172.21.15.47:0/1277580333 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe56c06db70 0x7fe56c070030 secure :-1 s=READY pgs=3430 cs=0 l=1 rev1=1 crypto rx=0x7fe574005fd0 tx=0x7fe57400b480 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:56.996 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:56.996+0000 7fe580ff9640 1 -- 172.21.15.47:0/1277580333 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe57c04d020 con 0x7fe584106830 2024-04-06T04:07:57.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:56 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:07:57.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:56 smithi102 ceph-mon[32821]: osdmap e769: 8 total, 8 up, 8 in 2024-04-06T04:07:57.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:56 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:07:57.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.177+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12} v 0) -- 0x7fe584109cf0 con 0x7fe584106830 2024-04-06T04:07:57.861 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.861+0000 7fe580ff9640 1 -- 172.21.15.47:0/1277580333 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]=0 pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' created v772) ==== 176+0+0 (secure 0 0 0) 0x7fe57c07dc30 con 0x7fe584106830 2024-04-06T04:07:57.975 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.975+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12} v 0) -- 0x7fe58402d340 con 0x7fe584106830 2024-04-06T04:07:57.976 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.976+0000 7fe580ff9640 1 -- 172.21.15.47:0/1277580333 <== mon.2 v2:172.21.15.47:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]=0 pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' already exists v772) ==== 183+0+0 (secure 0 0 0) 0x7fe57c081680 con 0x7fe584106830 2024-04-06T04:07:57.976 INFO:tasks.workunit.client.0.smithi047.stderr:pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' already exists 2024-04-06T04:07:57.978 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe56c06db70 msgr2=0x7fe56c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 --2- 172.21.15.47:0/1277580333 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe56c06db70 0x7fe56c070030 secure :-1 s=READY pgs=3430 cs=0 l=1 rev1=1 crypto rx=0x7fe574005fd0 tx=0x7fe57400b480 comp rx=0 tx=0).stop 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe584106830 msgr2=0x7fe58419bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe584106830 0x7fe58419bf60 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7fe57c02c430 tx=0x7fe57c033cb0 comp rx=0 tx=0).stop 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 shutdown_connections 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 --2- 172.21.15.47:0/1277580333 >> v2:172.21.15.47:6800/3359778320 conn(0x7fe56c06db70 0x7fe56c070030 unknown :-1 s=CLOSED pgs=3430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe584106830 0x7fe58419bf60 unknown :-1 s=CLOSED pgs=2560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe584100b10 0x7fe584197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 --2- 172.21.15.47:0/1277580333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe584100150 0x7fe5841976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 >> 172.21.15.47:0/1277580333 conn(0x7fe5840759c0 msgr2=0x7fe5840fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 shutdown_connections 2024-04-06T04:07:57.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:57.978+0000 7fe589ab0640 1 -- 172.21.15.47:0/1277580333 wait complete. 2024-04-06T04:07:57.988 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool application enable 432b0d4c-0aa7-47da-b6b8-69d933cee88c rados 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: osdmap e770: 8 total, 8 up, 8 in 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' no longer out of quota; removing NO_QUOTA flag 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: osdmap e771: 8 total, 8 up, 8 in 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: pgmap v1705: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1277580333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:57.992 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: osdmap e770: 8 total, 8 up, 8 in 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' no longer out of quota; removing NO_QUOTA flag 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: osdmap e771: 8 total, 8 up, 8 in 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: pgmap v1705: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1277580333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:57.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:57 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 -- 172.21.15.47:0/1863950878 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc60102160 msgr2=0x7fcc6010e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 --2- 172.21.15.47:0/1863950878 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc60102160 0x7fcc6010e670 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009cd0 tx=0x7fcc5802c0f0 comp rx=0 tx=0).stop 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 -- 172.21.15.47:0/1863950878 shutdown_connections 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 --2- 172.21.15.47:0/1863950878 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc60102160 0x7fcc6010e670 unknown :-1 s=CLOSED pgs=2561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 --2- 172.21.15.47:0/1863950878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc601017a0 0x7fcc60101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 --2- 172.21.15.47:0/1863950878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc601077b0 0x7fcc60107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 -- 172.21.15.47:0/1863950878 >> 172.21.15.47:0/1863950878 conn(0x7fcc600fd270 msgr2=0x7fcc600ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 -- 172.21.15.47:0/1863950878 shutdown_connections 2024-04-06T04:07:58.074 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.071+0000 7fcc659bb640 1 -- 172.21.15.47:0/1863950878 wait complete. 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc659bb640 1 Processor -- start 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc659bb640 1 -- start start 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc659bb640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc601017a0 0x7fcc6019d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc659bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc60102160 0x7fcc6019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc659bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc601077b0 0x7fcc60197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc659bb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcc601112d0 con 0x7fcc60102160 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc659bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcc60111150 con 0x7fcc601077b0 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc659bb640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fcc60111450 con 0x7fcc601017a0 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5effd640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc601017a0 0x7fcc6019d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc60102160 0x7fcc6019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5effd640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc601017a0 0x7fcc6019d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:44122/0 (socket says 172.21.15.47:44122) 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5effd640 1 -- 172.21.15.47:0/2514385214 learned_addr learned my addr 172.21.15.47:0/2514385214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5effd640 1 -- 172.21.15.47:0/2514385214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc601077b0 msgr2=0x7fcc60197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5f7fe640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc601077b0 0x7fcc60197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:58.075 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5effd640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc601077b0 0x7fcc60197600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5effd640 1 -- 172.21.15.47:0/2514385214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc60102160 msgr2=0x7fcc6019d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5effd640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc60102160 0x7fcc6019d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5effd640 1 -- 172.21.15.47:0/2514385214 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc60197d80 con 0x7fcc601017a0 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.072+0000 7fcc5e7fc640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc60102160 0x7fcc6019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.073+0000 7fcc5effd640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc601017a0 0x7fcc6019d450 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000b4a0 tx=0x7fcc5000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.073+0000 7fcc649b9640 1 -- 172.21.15.47:0/2514385214 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50014070 con 0x7fcc601017a0 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.073+0000 7fcc649b9640 1 -- 172.21.15.47:0/2514385214 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fcc50010ac0 con 0x7fcc601017a0 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.073+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc60198070 con 0x7fcc601017a0 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.073+0000 7fcc649b9640 1 -- 172.21.15.47:0/2514385214 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50017c00 con 0x7fcc601017a0 2024-04-06T04:07:58.076 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.073+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc601a4310 con 0x7fcc601017a0 2024-04-06T04:07:58.077 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.074+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc60068b10 con 0x7fcc601017a0 2024-04-06T04:07:58.077 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.074+0000 7fcc649b9640 1 -- 172.21.15.47:0/2514385214 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fcc50017070 con 0x7fcc601017a0 2024-04-06T04:07:58.077 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.075+0000 7fcc649b9640 1 --2- 172.21.15.47:0/2514385214 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc4806db70 0x7fcc48070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:58.077 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.075+0000 7fcc649b9640 1 -- 172.21.15.47:0/2514385214 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(772..772 src has 254..772) ==== 8193+0+0 (secure 0 0 0) 0x7fcc5008d6e0 con 0x7fcc601017a0 2024-04-06T04:07:58.077 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.075+0000 7fcc5e7fc640 1 --2- 172.21.15.47:0/2514385214 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc4806db70 0x7fcc48070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:58.077 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.075+0000 7fcc5e7fc640 1 --2- 172.21.15.47:0/2514385214 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc4806db70 0x7fcc48070030 secure :-1 s=READY pgs=3431 cs=0 l=1 rev1=1 crypto rx=0x7fcc540095f0 tx=0x7fcc54005f90 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:58.080 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.079+0000 7fcc649b9640 1 -- 172.21.15.47:0/2514385214 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcc5005e450 con 0x7fcc601017a0 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: osdmap e770: 8 total, 8 up, 8 in 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: pool '221d75c7-d61e-469a-8866-a0e9906e6a82' no longer out of quota; removing NO_QUOTA flag 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/640420995' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: osdmap e771: 8 total, 8 up, 8 in 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: pgmap v1705: 176 pgs: 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1277580333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:58.083 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:57 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:58.262 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.261+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"} v 0) -- 0x7fcc601a45a0 con 0x7fcc601017a0 2024-04-06T04:07:58.867 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.866+0000 7fcc649b9640 1 -- 172.21.15.47:0/2514385214 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]=0 enabled application 'rados' on pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' v773) ==== 213+0+0 (secure 0 0 0) 0x7fcc50062c80 con 0x7fcc601017a0 2024-04-06T04:07:58.987 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:58.986+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"} v 0) -- 0x7fcc601a47f0 con 0x7fcc601017a0 2024-04-06T04:07:59.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]': finished 2024-04-06T04:07:59.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[29365]: osdmap e772: 8 total, 8 up, 8 in 2024-04-06T04:07:59.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1277580333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:59.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:59.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2514385214' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:07:59.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:07:59.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]': finished 2024-04-06T04:07:59.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[37680]: osdmap e772: 8 total, 8 up, 8 in 2024-04-06T04:07:59.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1277580333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:59.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:59.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2514385214' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:07:59.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:58 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:07:59.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]': finished 2024-04-06T04:07:59.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:58 smithi102 ceph-mon[32821]: osdmap e772: 8 total, 8 up, 8 in 2024-04-06T04:07:59.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1277580333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:59.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pg_num": 12}]: dispatch 2024-04-06T04:07:59.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:58 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2514385214' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:07:59.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:58 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:07:59.873 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.872+0000 7fcc649b9640 1 -- 172.21.15.47:0/2514385214 <== mon.2 v2:172.21.15.47:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]=0 enabled application 'rados' on pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' v774) ==== 213+0+0 (secure 0 0 0) 0x7fcc50017de0 con 0x7fcc601017a0 2024-04-06T04:07:59.873 INFO:tasks.workunit.client.0.smithi047.stderr:enabled application 'rados' on pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' 2024-04-06T04:07:59.875 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc4806db70 msgr2=0x7fcc48070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 --2- 172.21.15.47:0/2514385214 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc4806db70 0x7fcc48070030 secure :-1 s=READY pgs=3431 cs=0 l=1 rev1=1 crypto rx=0x7fcc540095f0 tx=0x7fcc54005f90 comp rx=0 tx=0).stop 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc601017a0 msgr2=0x7fcc6019d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc601017a0 0x7fcc6019d450 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000b4a0 tx=0x7fcc5000b960 comp rx=0 tx=0).stop 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 shutdown_connections 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 --2- 172.21.15.47:0/2514385214 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc4806db70 0x7fcc48070030 unknown :-1 s=CLOSED pgs=3431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc601077b0 0x7fcc60197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc60102160 0x7fcc6019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 --2- 172.21.15.47:0/2514385214 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc601017a0 0x7fcc6019d450 unknown :-1 s=CLOSED pgs=2562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 >> 172.21.15.47:0/2514385214 conn(0x7fcc600fd270 msgr2=0x7fcc600fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 shutdown_connections 2024-04-06T04:07:59.876 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.875+0000 7fcc659bb640 1 -- 172.21.15.47:0/2514385214 wait complete. 2024-04-06T04:07:59.887 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool set-quota 432b0d4c-0aa7-47da-b6b8-69d933cee88c max_objects 10 2024-04-06T04:07:59.978 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/3831519252 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14103370 msgr2=0x7fcc1410b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:59.978 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/3831519252 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14103370 0x7fcc1410b850 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009ca0 tx=0x7fcc0402c180 comp rx=0 tx=0).stop 2024-04-06T04:07:59.978 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/3831519252 shutdown_connections 2024-04-06T04:07:59.978 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/3831519252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc1410be20 0x7fcc1410e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.978 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/3831519252 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14103370 0x7fcc1410b850 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/3831519252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14102a50 0x7fcc14102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/3831519252 >> 172.21.15.47:0/3831519252 conn(0x7fcc140778c0 msgr2=0x7fcc14077cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/3831519252 shutdown_connections 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.975+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/3831519252 wait complete. 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc1ab5e640 1 Processor -- start 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc1ab5e640 1 -- start start 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc1ab5e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14102a50 0x7fcc1419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc1ab5e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14103370 0x7fcc1419d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc1ab5e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc1410be20 0x7fcc14197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc1ab5e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcc141112c0 con 0x7fcc1410be20 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc1ab5e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcc14111140 con 0x7fcc14103370 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc1ab5e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fcc14111440 con 0x7fcc14102a50 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc188fa640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14102a50 0x7fcc1419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:59.979 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc190fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc1410be20 0x7fcc14197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc188fa640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14102a50 0x7fcc1419d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:44140/0 (socket says 172.21.15.47:44140) 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.976+0000 7fcc188fa640 1 -- 172.21.15.47:0/1368197787 learned_addr learned my addr 172.21.15.47:0/1368197787 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc13fff640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14103370 0x7fcc1419d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc188fa640 1 -- 172.21.15.47:0/1368197787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14103370 msgr2=0x7fcc1419d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc188fa640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14103370 0x7fcc1419d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc188fa640 1 -- 172.21.15.47:0/1368197787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc1410be20 msgr2=0x7fcc14197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc188fa640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc1410be20 0x7fcc14197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc188fa640 1 -- 172.21.15.47:0/1368197787 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc14197dd0 con 0x7fcc14102a50 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc13fff640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14103370 0x7fcc1419d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc190fb640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc1410be20 0x7fcc14197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc188fa640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14102a50 0x7fcc1419d450 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00c970 tx=0x7fcc0c00cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc11ffb640 1 -- 172.21.15.47:0/1368197787 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c007bb0 con 0x7fcc14102a50 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc11ffb640 1 -- 172.21.15.47:0/1368197787 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fcc0c007d50 con 0x7fcc14102a50 2024-04-06T04:07:59.980 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc141980c0 con 0x7fcc14102a50 2024-04-06T04:07:59.981 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc11ffb640 1 -- 172.21.15.47:0/1368197787 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c004e10 con 0x7fcc14102a50 2024-04-06T04:07:59.981 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.977+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc141a4310 con 0x7fcc14102a50 2024-04-06T04:07:59.981 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.978+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc14068b10 con 0x7fcc14102a50 2024-04-06T04:07:59.982 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.978+0000 7fcc11ffb640 1 -- 172.21.15.47:0/1368197787 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fcc0c004fd0 con 0x7fcc14102a50 2024-04-06T04:07:59.982 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.979+0000 7fcc11ffb640 1 --2- 172.21.15.47:0/1368197787 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc0006db70 0x7fcc00070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:07:59.982 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.979+0000 7fcc11ffb640 1 -- 172.21.15.47:0/1368197787 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(774..774 src has 254..774) ==== 8206+0+0 (secure 0 0 0) 0x7fcc0c08df80 con 0x7fcc14102a50 2024-04-06T04:07:59.982 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.979+0000 7fcc13fff640 1 --2- 172.21.15.47:0/1368197787 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc0006db70 0x7fcc00070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:07:59.982 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.979+0000 7fcc13fff640 1 --2- 172.21.15.47:0/1368197787 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc0006db70 0x7fcc00070030 secure :-1 s=READY pgs=3432 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009a60 tx=0x7fcc04000f40 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:07:59.984 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:07:59.984+0000 7fcc11ffb640 1 -- 172.21.15.47:0/1368197787 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcc0c014030 con 0x7fcc14102a50 2024-04-06T04:08:00.167 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:00.167+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"} v 0) -- 0x7fcc14106620 con 0x7fcc14102a50 2024-04-06T04:08:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]': finished 2024-04-06T04:08:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[29365]: osdmap e773: 8 total, 8 up, 8 in 2024-04-06T04:08:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2514385214' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:08:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:08:00.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[29365]: pgmap v1708: 188 pgs: 12 unknown, 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-06T04:08:00.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]': finished 2024-04-06T04:08:00.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[37680]: osdmap e773: 8 total, 8 up, 8 in 2024-04-06T04:08:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2514385214' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:08:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:08:00.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:07:59 smithi047 ceph-mon[37680]: pgmap v1708: 188 pgs: 12 unknown, 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-06T04:08:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]': finished 2024-04-06T04:08:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:59 smithi102 ceph-mon[32821]: osdmap e773: 8 total, 8 up, 8 in 2024-04-06T04:08:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:59 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2514385214' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:08:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:59 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]: dispatch 2024-04-06T04:08:00.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:07:59 smithi102 ceph-mon[32821]: pgmap v1708: 188 pgs: 12 unknown, 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-06T04:08:00.873 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:00.873+0000 7fcc11ffb640 1 -- 172.21.15.47:0/1368197787 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 432b0d4c-0aa7-47da-b6b8-69d933cee88c v775) ==== 223+0+0 (secure 0 0 0) 0x7fcc0c05b320 con 0x7fcc14102a50 2024-04-06T04:08:00.987 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:00.986+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"} v 0) -- 0x7fcc14106090 con 0x7fcc14102a50 2024-04-06T04:08:01.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]': finished 2024-04-06T04:08:01.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:00 smithi047 ceph-mon[29365]: osdmap e774: 8 total, 8 up, 8 in 2024-04-06T04:08:01.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:00 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1368197787' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:01.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:00 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:01.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]': finished 2024-04-06T04:08:01.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:00 smithi047 ceph-mon[37680]: osdmap e774: 8 total, 8 up, 8 in 2024-04-06T04:08:01.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:00 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1368197787' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:01.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:00 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:01.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "app": "rados"}]': finished 2024-04-06T04:08:01.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:00 smithi102 ceph-mon[32821]: osdmap e774: 8 total, 8 up, 8 in 2024-04-06T04:08:01.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:00 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1368197787' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:01.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:00 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:01.885 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.885+0000 7fcc11ffb640 1 -- 172.21.15.47:0/1368197787 <== mon.2 v2:172.21.15.47:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 432b0d4c-0aa7-47da-b6b8-69d933cee88c v776) ==== 223+0+0 (secure 0 0 0) 0x7fcc0c05ed70 con 0x7fcc14102a50 2024-04-06T04:08:01.886 INFO:tasks.workunit.client.0.smithi047.stderr:set-quota max_objects = 10 for pool 432b0d4c-0aa7-47da-b6b8-69d933cee88c 2024-04-06T04:08:01.888 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc0006db70 msgr2=0x7fcc00070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:08:01.888 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/1368197787 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc0006db70 0x7fcc00070030 secure :-1 s=READY pgs=3432 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009a60 tx=0x7fcc04000f40 comp rx=0 tx=0).stop 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14102a50 msgr2=0x7fcc1419d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14102a50 0x7fcc1419d450 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00c970 tx=0x7fcc0c00cd70 comp rx=0 tx=0).stop 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 shutdown_connections 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/1368197787 >> v2:172.21.15.47:6800/3359778320 conn(0x7fcc0006db70 0x7fcc00070030 unknown :-1 s=CLOSED pgs=3432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc1410be20 0x7fcc14197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14103370 0x7fcc1419d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 --2- 172.21.15.47:0/1368197787 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcc14102a50 0x7fcc1419d450 unknown :-1 s=CLOSED pgs=2564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 >> 172.21.15.47:0/1368197787 conn(0x7fcc140778c0 msgr2=0x7fcc141037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 shutdown_connections 2024-04-06T04:08:01.889 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:08:01.888+0000 7fcc1ab5e640 1 -- 172.21.15.47:0/1368197787 wait complete. 2024-04-06T04:08:01.900 INFO:tasks.workunit.client.0.smithi047.stderr:+ sleep 30 2024-04-06T04:08:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:08:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[29365]: osdmap e775: 8 total, 8 up, 8 in 2024-04-06T04:08:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1368197787' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:02.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[29365]: pgmap v1711: 188 pgs: 12 unknown, 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail 2024-04-06T04:08:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:08:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[37680]: osdmap e775: 8 total, 8 up, 8 in 2024-04-06T04:08:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1368197787' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:02.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:01 smithi047 ceph-mon[37680]: pgmap v1711: 188 pgs: 12 unknown, 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail 2024-04-06T04:08:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:08:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:01 smithi102 ceph-mon[32821]: osdmap e775: 8 total, 8 up, 8 in 2024-04-06T04:08:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:01 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1368197787' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:01 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]: dispatch 2024-04-06T04:08:02.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:01 smithi102 ceph-mon[32821]: pgmap v1711: 188 pgs: 12 unknown, 176 active+clean; 721 KiB data, 853 MiB used, 714 GiB / 715 GiB avail 2024-04-06T04:08:03.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:02 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:08:03.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:02 smithi047 ceph-mon[29365]: osdmap e776: 8 total, 8 up, 8 in 2024-04-06T04:08:03.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:02 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:08:03.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:02 smithi047 ceph-mon[37680]: osdmap e776: 8 total, 8 up, 8 in 2024-04-06T04:08:03.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:02 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "field": "max_objects", "val": "10"}]': finished 2024-04-06T04:08:03.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:02 smithi102 ceph-mon[32821]: osdmap e776: 8 total, 8 up, 8 in 2024-04-06T04:08:03.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:08:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:08:04.143 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:03 smithi047 ceph-mon[29365]: pgmap v1713: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.8 KiB/s wr, 1 op/s 2024-04-06T04:08:04.144 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:03 smithi047 ceph-mon[37680]: pgmap v1713: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.8 KiB/s wr, 1 op/s 2024-04-06T04:08:04.144 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:08:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:08:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:08:04.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:03 smithi102 ceph-mon[32821]: pgmap v1713: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.8 KiB/s wr, 1 op/s 2024-04-06T04:08:05.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:04 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:05.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:05.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:04 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:05.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:04 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:05.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:05.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:04 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:04 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:05.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:04 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:06.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:05 smithi047 ceph-mon[29365]: pgmap v1714: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-06T04:08:06.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:05 smithi047 ceph-mon[37680]: pgmap v1714: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-06T04:08:06.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:05 smithi102 ceph-mon[32821]: pgmap v1714: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-06T04:08:08.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:08 smithi102 ceph-mon[32821]: pgmap v1715: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.4 KiB/s wr, 1 op/s 2024-04-06T04:08:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:08 smithi047 ceph-mon[29365]: pgmap v1715: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.4 KiB/s wr, 1 op/s 2024-04-06T04:08:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:08 smithi047 ceph-mon[37680]: pgmap v1715: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.4 KiB/s wr, 1 op/s 2024-04-06T04:08:10.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:10 smithi102 ceph-mon[32821]: pgmap v1716: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-04-06T04:08:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:10 smithi047 ceph-mon[29365]: pgmap v1716: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-04-06T04:08:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:10 smithi047 ceph-mon[37680]: pgmap v1716: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-04-06T04:08:12.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:12 smithi102 ceph-mon[32821]: pgmap v1717: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-04-06T04:08:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:12 smithi047 ceph-mon[29365]: pgmap v1717: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-04-06T04:08:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:12 smithi047 ceph-mon[37680]: pgmap v1717: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-04-06T04:08:13.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:08:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:08:14.073 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:08:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:08:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:08:14.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:14 smithi102 ceph-mon[32821]: pgmap v1718: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 919 B/s rd, 0 op/s 2024-04-06T04:08:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:14 smithi047 ceph-mon[29365]: pgmap v1718: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 919 B/s rd, 0 op/s 2024-04-06T04:08:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:14 smithi047 ceph-mon[37680]: pgmap v1718: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 919 B/s rd, 0 op/s 2024-04-06T04:08:15.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:15 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:15.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:15 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:15.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:15 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:16.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:16 smithi102 ceph-mon[32821]: pgmap v1719: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:16 smithi047 ceph-mon[29365]: pgmap v1719: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:16.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:16 smithi047 ceph-mon[37680]: pgmap v1719: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:18.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:17 smithi047 ceph-mon[29365]: pgmap v1720: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:18.243 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:17 smithi047 ceph-mon[37680]: pgmap v1720: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:18.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:17 smithi102 ceph-mon[32821]: pgmap v1720: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:20 smithi102 ceph-mon[32821]: pgmap v1721: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:20.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:20 smithi047 ceph-mon[37680]: pgmap v1721: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:20 smithi047 ceph-mon[29365]: pgmap v1721: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:22.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:22 smithi102 ceph-mon[32821]: pgmap v1722: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:22 smithi047 ceph-mon[29365]: pgmap v1722: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:22.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:22 smithi047 ceph-mon[37680]: pgmap v1722: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:23.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:08:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:08:24.075 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:08:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:08:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:08:24.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:24 smithi102 ceph-mon[32821]: pgmap v1723: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:24 smithi047 ceph-mon[29365]: pgmap v1723: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:24.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:24 smithi047 ceph-mon[37680]: pgmap v1723: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:25.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:25 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:25.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:25 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:25.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:25 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:26.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:26 smithi102 ceph-mon[32821]: pgmap v1724: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:26 smithi047 ceph-mon[29365]: pgmap v1724: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:26.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:26 smithi047 ceph-mon[37680]: pgmap v1724: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:28 smithi047 ceph-mon[29365]: pgmap v1725: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:28 smithi047 ceph-mon[37680]: pgmap v1725: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:28 smithi102 ceph-mon[32821]: pgmap v1725: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:30 smithi047 ceph-mon[29365]: pgmap v1726: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:30 smithi047 ceph-mon[37680]: pgmap v1726: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:30 smithi102 ceph-mon[32821]: pgmap v1726: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:31.901 INFO:tasks.workunit.client.0.smithi047.stderr:++ seq 1 10 2024-04-06T04:08:31.902 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:31.902 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj1 /etc/passwd 2024-04-06T04:08:31.944 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:31.944 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj2 /etc/passwd 2024-04-06T04:08:31.982 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:31.982 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj3 /etc/passwd 2024-04-06T04:08:32.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:32.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj4 /etc/passwd 2024-04-06T04:08:32.054 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:32.054 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj5 /etc/passwd 2024-04-06T04:08:32.089 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:32.089 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj6 /etc/passwd 2024-04-06T04:08:32.124 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:32.124 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj7 /etc/passwd 2024-04-06T04:08:32.159 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:32.159 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj8 /etc/passwd 2024-04-06T04:08:32.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:32.194 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj9 /etc/passwd 2024-04-06T04:08:32.229 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in `seq 1 10` 2024-04-06T04:08:32.229 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 432b0d4c-0aa7-47da-b6b8-69d933cee88c put obj10 /etc/passwd 2024-04-06T04:08:32.264 INFO:tasks.workunit.client.0.smithi047.stderr:+ sleep 30 2024-04-06T04:08:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:32 smithi047 ceph-mon[29365]: pgmap v1727: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:32.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:32 smithi047 ceph-mon[37680]: pgmap v1727: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:32.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:32 smithi102 ceph-mon[32821]: pgmap v1727: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:33.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:08:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:08:34.092 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:08:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:08:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:08:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:34 smithi047 ceph-mon[29365]: pgmap v1728: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:34 smithi047 ceph-mon[37680]: pgmap v1728: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:34 smithi102 ceph-mon[32821]: pgmap v1728: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:35 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:35 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:35 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:36 smithi047 ceph-mon[29365]: pgmap v1729: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:36 smithi047 ceph-mon[37680]: pgmap v1729: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:36 smithi102 ceph-mon[32821]: pgmap v1729: 188 pgs: 188 active+clean; 744 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:38 smithi047 ceph-mon[29365]: pgmap v1730: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-04-06T04:08:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:38 smithi047 ceph-mon[37680]: pgmap v1730: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-04-06T04:08:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:38 smithi102 ceph-mon[32821]: pgmap v1730: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-04-06T04:08:40.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:40 smithi047 ceph-mon[29365]: pgmap v1731: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-04-06T04:08:40.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:40 smithi047 ceph-mon[37680]: pgmap v1731: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-04-06T04:08:40.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:40 smithi102 ceph-mon[32821]: pgmap v1731: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-04-06T04:08:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:42 smithi047 ceph-mon[29365]: pgmap v1732: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-04-06T04:08:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:42 smithi047 ceph-mon[29365]: pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' is full (reached quota's max_objects: 10) 2024-04-06T04:08:42.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:42 smithi047 ceph-mon[29365]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:08:42.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:42 smithi047 ceph-mon[29365]: osdmap e777: 8 total, 8 up, 8 in 2024-04-06T04:08:42.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:42 smithi047 ceph-mon[37680]: pgmap v1732: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-04-06T04:08:42.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:42 smithi047 ceph-mon[37680]: pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' is full (reached quota's max_objects: 10) 2024-04-06T04:08:42.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:42 smithi047 ceph-mon[37680]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:08:42.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:42 smithi047 ceph-mon[37680]: osdmap e777: 8 total, 8 up, 8 in 2024-04-06T04:08:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:42 smithi102 ceph-mon[32821]: pgmap v1732: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-04-06T04:08:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:42 smithi102 ceph-mon[32821]: pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' is full (reached quota's max_objects: 10) 2024-04-06T04:08:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:42 smithi102 ceph-mon[32821]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-06T04:08:42.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:42 smithi102 ceph-mon[32821]: osdmap e777: 8 total, 8 up, 8 in 2024-04-06T04:08:43.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:08:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:08:44.109 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:08:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:08:43] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:08:44.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:44 smithi047 ceph-mon[29365]: pgmap v1734: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-06T04:08:44.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:44 smithi047 ceph-mon[37680]: pgmap v1734: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-06T04:08:44.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:44 smithi102 ceph-mon[32821]: pgmap v1734: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-06T04:08:45.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:45 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:45.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:45 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:45.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:45 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:46.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:46 smithi047 ceph-mon[29365]: pgmap v1735: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-06T04:08:46.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:46 smithi047 ceph-mon[37680]: pgmap v1735: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-06T04:08:46.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:46 smithi102 ceph-mon[32821]: pgmap v1735: 188 pgs: 188 active+clean; 859 KiB data, 826 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-06T04:08:48.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:48 smithi047 ceph-mon[29365]: pgmap v1736: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:48.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:48 smithi047 ceph-mon[37680]: pgmap v1736: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:48.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:48 smithi102 ceph-mon[32821]: pgmap v1736: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:50 smithi047 ceph-mon[37680]: pgmap v1737: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:50.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:50 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:50.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:50 smithi047 ceph-mon[29365]: pgmap v1737: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:50.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:50.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:50 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:50 smithi102 ceph-mon[32821]: pgmap v1737: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:50.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:50 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:08:52.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:52 smithi047 ceph-mon[29365]: pgmap v1738: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:52.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:52 smithi047 ceph-mon[37680]: pgmap v1738: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:52.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:52 smithi102 ceph-mon[32821]: pgmap v1738: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T04:08:53.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:08:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:08:54.126 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:08:53 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:08:53] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:08:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[29365]: pgmap v1739: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-04-06T04:08:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:08:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:08:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:08:54.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[37680]: pgmap v1739: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-04-06T04:08:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:08:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:08:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:08:54.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:54 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:54 smithi102 ceph-mon[32821]: pgmap v1739: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-04-06T04:08:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:54 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T04:08:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:54 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T04:08:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:54 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T04:08:54.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:54 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' 2024-04-06T04:08:55.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:55 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:55.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:55 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:55.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:55 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:08:56.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:56 smithi047 ceph-mon[29365]: pgmap v1740: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:56.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:56 smithi047 ceph-mon[37680]: pgmap v1740: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:56.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:56 smithi102 ceph-mon[32821]: pgmap v1740: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:08:58.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:08:58 smithi047 ceph-mon[29365]: pgmap v1741: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:58.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:08:58 smithi047 ceph-mon[37680]: pgmap v1741: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:08:58.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:08:58 smithi102 ceph-mon[32821]: pgmap v1741: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:00.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:00 smithi047 ceph-mon[29365]: pgmap v1742: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:00.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:00 smithi047 ceph-mon[37680]: pgmap v1742: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:00.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:00 smithi102 ceph-mon[32821]: pgmap v1742: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:02.265 INFO:tasks.workunit.client.0.smithi047.stderr:+ rados -p 221d75c7-d61e-469a-8866-a0e9906e6a82 put threemore /etc/passwd 2024-04-06T04:09:02.305 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool set-quota 221d75c7-d61e-469a-8866-a0e9906e6a82 max_bytes 0 2024-04-06T04:09:02.397 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 -- 172.21.15.47:0/2954934337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 msgr2=0x7f3504106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 --2- 172.21.15.47:0/2954934337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 0x7f3504106a90 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009930 tx=0x7f34f802bc30 comp rx=0 tx=0).stop 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 -- 172.21.15.47:0/2954934337 shutdown_connections 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 --2- 172.21.15.47:0/2954934337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3504101060 0x7f350410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 --2- 172.21.15.47:0/2954934337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041006a0 0x7f3504100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 --2- 172.21.15.47:0/2954934337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 0x7f3504106a90 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 -- 172.21.15.47:0/2954934337 >> 172.21.15.47:0/2954934337 conn(0x7f3504077800 msgr2=0x7f3504077c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 -- 172.21.15.47:0/2954934337 shutdown_connections 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 -- 172.21.15.47:0/2954934337 wait complete. 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 Processor -- start 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.395+0000 7f350ac36640 1 -- start start 2024-04-06T04:09:02.398 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f350ac36640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35041006a0 0x7f35041986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f350ac36640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3504101060 0x7f3504198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f350ac36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 0x7f35041a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f350ac36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3504110190 con 0x7f35041066b0 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f350ac36640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3504110010 con 0x7f3504101060 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f350ac36640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f3504110310 con 0x7f35041006a0 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35041006a0 0x7f35041986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35091d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 0x7f35041a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35041006a0 0x7f35041986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:51312/0 (socket says 172.21.15.47:51312) 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 -- 172.21.15.47:0/468148588 learned_addr learned my addr 172.21.15.47:0/468148588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f3503fff640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3504101060 0x7f3504198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 -- 172.21.15.47:0/468148588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3504101060 msgr2=0x7f3504198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3504101060 0x7f3504198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 -- 172.21.15.47:0/468148588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 msgr2=0x7f35041a3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 0x7f35041a3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:02.399 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35041a3c80 con 0x7f35041006a0 2024-04-06T04:09:02.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35091d3640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 0x7f35041a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:09:02.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f35089d2640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35041006a0 0x7f35041986c0 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009230 tx=0x7f34f802c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:09:02.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8043020 con 0x7f35041006a0 2024-04-06T04:09:02.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f34f80043d0 con 0x7f35041006a0 2024-04-06T04:09:02.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35041a3e50 con 0x7f35041006a0 2024-04-06T04:09:02.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.396+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8003a90 con 0x7f35041006a0 2024-04-06T04:09:02.400 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.397+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35041a42b0 con 0x7f35041006a0 2024-04-06T04:09:02.401 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.398+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3504101de0 con 0x7f35041006a0 2024-04-06T04:09:02.401 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.398+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f34f8046020 con 0x7f35041006a0 2024-04-06T04:09:02.401 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.399+0000 7f3501ffb640 1 --2- 172.21.15.47:0/468148588 >> v2:172.21.15.47:6800/3359778320 conn(0x7f34f406db70 0x7f34f4070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:02.401 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.399+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(777..777 src has 254..777) ==== 8206+0+0 (secure 0 0 0) 0x7f34f80afdb0 con 0x7f35041006a0 2024-04-06T04:09:02.401 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.399+0000 7f3503fff640 1 --2- 172.21.15.47:0/468148588 >> v2:172.21.15.47:6800/3359778320 conn(0x7f34f406db70 0x7f34f4070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:02.401 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.399+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=778}) -- 0x7f34f40798f0 con 0x7f35041006a0 2024-04-06T04:09:02.401 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.399+0000 7f3503fff640 1 --2- 172.21.15.47:0/468148588 >> v2:172.21.15.47:6800/3359778320 conn(0x7f34f406db70 0x7f34f4070030 secure :-1 s=READY pgs=3444 cs=0 l=1 rev1=1 crypto rx=0x7f3504069660 tx=0x7f34f000b390 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:09:02.404 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.403+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f34f804d070 con 0x7f35041006a0 2024-04-06T04:09:02.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:02 smithi047 ceph-mon[29365]: pgmap v1743: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:02.495 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:02 smithi047 ceph-mon[37680]: pgmap v1743: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:02.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:02 smithi102 ceph-mon[32821]: pgmap v1743: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:02.586 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:02.586+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"} v 0) -- 0x7f3504069100 con 0x7f35041006a0 2024-04-06T04:09:03.146 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:03.145+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 7 ==== osd_map(778..778 src has 254..778) ==== 628+0+0 (secure 0 0 0) 0x7f34f807aa50 con 0x7f35041006a0 2024-04-06T04:09:03.146 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:03.145+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=779}) -- 0x7f34f407a480 con 0x7f35041006a0 2024-04-06T04:09:03.152 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:03.151+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v778) ==== 217+0+0 (secure 0 0 0) 0x7f34f807d0b0 con 0x7f35041006a0 2024-04-06T04:09:03.262 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:03.261+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"} v 0) -- 0x7f3504108c10 con 0x7f35041006a0 2024-04-06T04:09:03.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:03 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/468148588' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:03.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:03 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:03.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:03 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/468148588' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:03.493 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:03 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:03.513 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:03 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/468148588' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:03.513 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:03 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:03.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:09:03 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:09:04.148 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.147+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 9 ==== osd_map(779..779 src has 254..779) ==== 628+0+0 (secure 0 0 0) 0x7f34f80ad9b0 con 0x7f35041006a0 2024-04-06T04:09:04.148 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.147+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=780}) -- 0x7f34f407a8b0 con 0x7f35041006a0 2024-04-06T04:09:04.153 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.152+0000 7f3501ffb640 1 -- 172.21.15.47:0/468148588 <== mon.2 v2:172.21.15.47:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v779) ==== 217+0+0 (secure 0 0 0) 0x7f34f8080b00 con 0x7f35041006a0 2024-04-06T04:09:04.153 INFO:tasks.workunit.client.0.smithi047.stderr:set-quota max_bytes = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 2024-04-06T04:09:04.156 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:09:03] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 >> v2:172.21.15.47:6800/3359778320 conn(0x7f34f406db70 msgr2=0x7f34f4070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 --2- 172.21.15.47:0/468148588 >> v2:172.21.15.47:6800/3359778320 conn(0x7f34f406db70 0x7f34f4070030 secure :-1 s=READY pgs=3444 cs=0 l=1 rev1=1 crypto rx=0x7f3504069660 tx=0x7f34f000b390 comp rx=0 tx=0).stop 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35041006a0 msgr2=0x7f35041986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35041006a0 0x7f35041986c0 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009230 tx=0x7f34f802c790 comp rx=0 tx=0).stop 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 shutdown_connections 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 --2- 172.21.15.47:0/468148588 >> v2:172.21.15.47:6800/3359778320 conn(0x7f34f406db70 0x7f34f4070030 unknown :-1 s=CLOSED pgs=3444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35041066b0 0x7f35041a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3504101060 0x7f3504198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.157 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 --2- 172.21.15.47:0/468148588 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35041006a0 0x7f35041986c0 unknown :-1 s=CLOSED pgs=2580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.158 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.156+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 >> 172.21.15.47:0/468148588 conn(0x7f3504077800 msgr2=0x7f35041033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:09:04.158 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.157+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 shutdown_connections 2024-04-06T04:09:04.158 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.157+0000 7f350ac36640 1 -- 172.21.15.47:0/468148588 wait complete. 2024-04-06T04:09:04.169 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool set-quota 221d75c7-d61e-469a-8866-a0e9906e6a82 max_objects 0 2024-04-06T04:09:04.263 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.260+0000 7f9fabad1640 1 -- 172.21.15.47:0/679013945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 msgr2=0x7f9fa4106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:04.263 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.260+0000 7f9fabad1640 1 --2- 172.21.15.47:0/679013945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 0x7f9fa4106a90 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009930 tx=0x7f9fa002bc30 comp rx=0 tx=0).stop 2024-04-06T04:09:04.263 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.260+0000 7f9fabad1640 1 -- 172.21.15.47:0/679013945 shutdown_connections 2024-04-06T04:09:04.263 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.260+0000 7f9fabad1640 1 --2- 172.21.15.47:0/679013945 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9fa4101060 0x7f9fa410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.263 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.260+0000 7f9fabad1640 1 --2- 172.21.15.47:0/679013945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa41006a0 0x7f9fa4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.260+0000 7f9fabad1640 1 --2- 172.21.15.47:0/679013945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 0x7f9fa4106a90 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.260+0000 7f9fabad1640 1 -- 172.21.15.47:0/679013945 >> 172.21.15.47:0/679013945 conn(0x7f9fa4077800 msgr2=0x7f9fa4077c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 -- 172.21.15.47:0/679013945 shutdown_connections 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 -- 172.21.15.47:0/679013945 wait complete. 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 Processor -- start 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 -- start start 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa41006a0 0x7f9fa4196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9fa4101060 0x7f9fa4196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 0x7f9fa419b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4110190 con 0x7f9fa41066b0 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4110010 con 0x7f9fa41006a0 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fabad1640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa4110310 con 0x7f9fa4101060 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9fa906c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9fa4101060 0x7f9fa4196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.261+0000 7f9faa06e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 0x7f9fa419b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:04.264 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa906c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9fa4101060 0x7f9fa4196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:51340/0 (socket says 172.21.15.47:51340) 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa906c640 1 -- 172.21.15.47:0/2100566347 learned_addr learned my addr 172.21.15.47:0/2100566347 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa986d640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa41006a0 0x7f9fa4196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa906c640 1 -- 172.21.15.47:0/2100566347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa41006a0 msgr2=0x7f9fa4196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa906c640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa41006a0 0x7f9fa4196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa906c640 1 -- 172.21.15.47:0/2100566347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 msgr2=0x7f9fa419b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa906c640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 0x7f9fa419b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa906c640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa419b750 con 0x7f9fa4101060 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9faa06e640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 0x7f9fa419b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fa906c640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9fa4101060 0x7f9fa4196ca0 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009900 tx=0x7f9f94009d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:09:04.265 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9400d030 con 0x7f9fa4101060 2024-04-06T04:09:04.266 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f9f9400d1d0 con 0x7f9fa4101060 2024-04-06T04:09:04.266 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa419ba40 con 0x7f9fa4101060 2024-04-06T04:09:04.266 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94004a00 con 0x7f9fa4101060 2024-04-06T04:09:04.266 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.262+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa4068b10 con 0x7f9fa4101060 2024-04-06T04:09:04.267 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.263+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa40686c0 con 0x7f9fa4101060 2024-04-06T04:09:04.267 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.264+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f9f94004ba0 con 0x7f9fa4101060 2024-04-06T04:09:04.267 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.264+0000 7f9f9affd640 1 --2- 172.21.15.47:0/2100566347 >> v2:172.21.15.47:6800/3359778320 conn(0x7f9f9006db70 0x7f9f90070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:04.267 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.264+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(779..779 src has 254..779) ==== 8206+0+0 (secure 0 0 0) 0x7f9f9408f5c0 con 0x7f9fa4101060 2024-04-06T04:09:04.267 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.264+0000 7f9fa986d640 1 --2- 172.21.15.47:0/2100566347 >> v2:172.21.15.47:6800/3359778320 conn(0x7f9f9006db70 0x7f9f90070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:04.267 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.264+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=780}) -- 0x7f9f900798f0 con 0x7f9fa4101060 2024-04-06T04:09:04.268 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.265+0000 7f9fa986d640 1 --2- 172.21.15.47:0/2100566347 >> v2:172.21.15.47:6800/3359778320 conn(0x7f9f9006db70 0x7f9f90070030 secure :-1 s=READY pgs=3445 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0005ab0 tx=0x7f9fa0005fd0 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:09:04.269 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.269+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9f94060310 con 0x7f9fa4101060 2024-04-06T04:09:04.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[29365]: pgmap v1744: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:04.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:09:04.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[29365]: osdmap e778: 8 total, 8 up, 8 in 2024-04-06T04:09:04.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/468148588' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:04.440 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:04.440 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[37680]: pgmap v1744: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:04.440 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:09:04.440 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[37680]: osdmap e778: 8 total, 8 up, 8 in 2024-04-06T04:09:04.440 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/468148588' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:04.440 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:04 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:04.453 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:04.453+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"} v 0) -- 0x7f9fa4197ab0 con 0x7f9fa4101060 2024-04-06T04:09:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:04 smithi102 ceph-mon[32821]: pgmap v1744: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:09:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:04 smithi102 ceph-mon[32821]: osdmap e778: 8 total, 8 up, 8 in 2024-04-06T04:09:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:04 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/468148588' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:04.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:04 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-06T04:09:05.166 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:05.162+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 7 ==== osd_map(780..780 src has 254..780) ==== 628+0+0 (secure 0 0 0) 0x7f9f940c3280 con 0x7f9fa4101060 2024-04-06T04:09:05.166 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:05.162+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=781}) -- 0x7f9f9007a480 con 0x7f9fa4101060 2024-04-06T04:09:05.166 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:05.165+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v780) ==== 221+0+0 (secure 0 0 0) 0x7f9f94064b40 con 0x7f9fa4101060 2024-04-06T04:09:05.277 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:05.276+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"} v 0) -- 0x7f9fa4069730 con 0x7f9fa4101060 2024-04-06T04:09:05.410 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[37680]: osdmap e779: 8 total, 8 up, 8 in 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2100566347' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[29365]: osdmap e779: 8 total, 8 up, 8 in 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2100566347' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:05.411 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:05 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:05 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_bytes", "val": "0"}]': finished 2024-04-06T04:09:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:05 smithi102 ceph-mon[32821]: osdmap e779: 8 total, 8 up, 8 in 2024-04-06T04:09:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:05 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2100566347' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:05.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:05 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:05.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:05 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:06.169 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.168+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 9 ==== osd_map(781..781 src has 254..781) ==== 628+0+0 (secure 0 0 0) 0x7f9f9405a310 con 0x7f9fa4101060 2024-04-06T04:09:06.169 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.168+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=782}) -- 0x7f9f9007aa80 con 0x7f9fa4101060 2024-04-06T04:09:06.175 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.174+0000 7f9f9affd640 1 -- 172.21.15.47:0/2100566347 <== mon.2 v2:172.21.15.47:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 v781) ==== 221+0+0 (secure 0 0 0) 0x7f9f9408d1c0 con 0x7f9fa4101060 2024-04-06T04:09:06.175 INFO:tasks.workunit.client.0.smithi047.stderr:set-quota max_objects = 0 for pool 221d75c7-d61e-469a-8866-a0e9906e6a82 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 >> v2:172.21.15.47:6800/3359778320 conn(0x7f9f9006db70 msgr2=0x7f9f90070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 --2- 172.21.15.47:0/2100566347 >> v2:172.21.15.47:6800/3359778320 conn(0x7f9f9006db70 0x7f9f90070030 secure :-1 s=READY pgs=3445 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0005ab0 tx=0x7f9fa0005fd0 comp rx=0 tx=0).stop 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9fa4101060 msgr2=0x7f9fa4196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9fa4101060 0x7f9fa4196ca0 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009900 tx=0x7f9f94009d00 comp rx=0 tx=0).stop 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 shutdown_connections 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 --2- 172.21.15.47:0/2100566347 >> v2:172.21.15.47:6800/3359778320 conn(0x7f9f9006db70 0x7f9f90070030 unknown :-1 s=CLOSED pgs=3445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fa41066b0 0x7f9fa419b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9fa4101060 0x7f9fa4196ca0 unknown :-1 s=CLOSED pgs=2581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 --2- 172.21.15.47:0/2100566347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa41006a0 0x7f9fa4196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 >> 172.21.15.47:0/2100566347 conn(0x7f9fa4077800 msgr2=0x7f9fa41033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:09:06.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 shutdown_connections 2024-04-06T04:09:06.179 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:06.177+0000 7f9fabad1640 1 -- 172.21.15.47:0/2100566347 wait complete. 2024-04-06T04:09:06.188 INFO:tasks.workunit.client.0.smithi047.stderr:+ sleep 30 2024-04-06T04:09:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[37680]: pgmap v1747: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T04:09:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:09:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[37680]: osdmap e780: 8 total, 8 up, 8 in 2024-04-06T04:09:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/2100566347' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:06.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:06.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[29365]: pgmap v1747: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T04:09:06.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:09:06.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[29365]: osdmap e780: 8 total, 8 up, 8 in 2024-04-06T04:09:06.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/2100566347' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:06.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:06 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:06 smithi102 ceph-mon[32821]: pgmap v1747: 188 pgs: 188 active+clean; 859 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T04:09:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:09:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:06 smithi102 ceph-mon[32821]: osdmap e780: 8 total, 8 up, 8 in 2024-04-06T04:09:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:06 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/2100566347' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:06.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:06 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]: dispatch 2024-04-06T04:09:07.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:07 smithi047 ceph-mon[37680]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:09:07.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:07 smithi047 ceph-mon[37680]: osdmap e781: 8 total, 8 up, 8 in 2024-04-06T04:09:07.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:07 smithi047 ceph-mon[29365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:09:07.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:07 smithi047 ceph-mon[29365]: osdmap e781: 8 total, 8 up, 8 in 2024-04-06T04:09:07.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:07 smithi102 ceph-mon[32821]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "field": "max_objects", "val": "0"}]': finished 2024-04-06T04:09:07.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:07 smithi102 ceph-mon[32821]: osdmap e781: 8 total, 8 up, 8 in 2024-04-06T04:09:08.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:08 smithi047 ceph-mon[29365]: pgmap v1750: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-06T04:09:08.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:08 smithi047 ceph-mon[37680]: pgmap v1750: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-06T04:09:08.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:08 smithi102 ceph-mon[32821]: pgmap v1750: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-06T04:09:10.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:10 smithi047 ceph-mon[29365]: pgmap v1751: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 869 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-04-06T04:09:10.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:10 smithi047 ceph-mon[37680]: pgmap v1751: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 869 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-04-06T04:09:10.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:10 smithi102 ceph-mon[32821]: pgmap v1751: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 869 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-04-06T04:09:12.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:12 smithi047 ceph-mon[29365]: pgmap v1752: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 743 B/s rd, 1.7 KiB/s wr, 0 op/s 2024-04-06T04:09:12.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:12 smithi047 ceph-mon[37680]: pgmap v1752: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 743 B/s rd, 1.7 KiB/s wr, 0 op/s 2024-04-06T04:09:12.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:12 smithi102 ceph-mon[32821]: pgmap v1752: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 743 B/s rd, 1.7 KiB/s wr, 0 op/s 2024-04-06T04:09:13.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:09:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:09:14.182 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:13 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:09:13] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:09:14.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:14 smithi047 ceph-mon[29365]: pgmap v1753: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-04-06T04:09:14.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:14 smithi047 ceph-mon[37680]: pgmap v1753: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-04-06T04:09:14.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:14 smithi102 ceph-mon[32821]: pgmap v1753: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-04-06T04:09:15.471 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:15 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:15.471 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:15 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:15.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:15 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:16.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:16 smithi047 ceph-mon[29365]: pgmap v1754: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 1 op/s 2024-04-06T04:09:16.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:16 smithi047 ceph-mon[37680]: pgmap v1754: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 1 op/s 2024-04-06T04:09:16.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:16 smithi102 ceph-mon[32821]: pgmap v1754: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 1 op/s 2024-04-06T04:09:18.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:18 smithi047 ceph-mon[29365]: pgmap v1755: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-04-06T04:09:18.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:18 smithi047 ceph-mon[37680]: pgmap v1755: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-04-06T04:09:18.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:18 smithi102 ceph-mon[32821]: pgmap v1755: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-04-06T04:09:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:20 smithi047 ceph-mon[37680]: pgmap v1756: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:20.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:20 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:20 smithi047 ceph-mon[29365]: pgmap v1756: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:20.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:20 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:20 smithi102 ceph-mon[32821]: pgmap v1756: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:20.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:20 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:22.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:22 smithi047 ceph-mon[29365]: pgmap v1757: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:22.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:22 smithi047 ceph-mon[37680]: pgmap v1757: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:22.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:22 smithi102 ceph-mon[32821]: pgmap v1757: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:23.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:09:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:09:24.199 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:23 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:09:23] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:09:24.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:24 smithi047 ceph-mon[29365]: pgmap v1758: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:24.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:24 smithi047 ceph-mon[37680]: pgmap v1758: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:24.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:24 smithi102 ceph-mon[32821]: pgmap v1758: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:25.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:25 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:25.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:25 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:25.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:25 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:26.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:26 smithi047 ceph-mon[29365]: pgmap v1759: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:26.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:26 smithi047 ceph-mon[37680]: pgmap v1759: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:26.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:26 smithi102 ceph-mon[32821]: pgmap v1759: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:28.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:28 smithi047 ceph-mon[29365]: pgmap v1760: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:28.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:28 smithi047 ceph-mon[37680]: pgmap v1760: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:28.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:28 smithi102 ceph-mon[32821]: pgmap v1760: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:30.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:30 smithi047 ceph-mon[29365]: pgmap v1761: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:09:30.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:30 smithi047 ceph-mon[37680]: pgmap v1761: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:09:30.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:30 smithi102 ceph-mon[32821]: pgmap v1761: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:09:32.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:32 smithi047 ceph-mon[29365]: pgmap v1762: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:32.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:32 smithi047 ceph-mon[37680]: pgmap v1762: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:32.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:32 smithi102 ceph-mon[32821]: pgmap v1762: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T04:09:33.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:09:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:09:34.217 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:33 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: ::ffff:172.21.15.102 - - [06/Apr/2024:04:09:33] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-06T04:09:34.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:34 smithi047 ceph-mon[37680]: pgmap v1763: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:34.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:34 smithi047 ceph-mon[29365]: pgmap v1763: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:34.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:34 smithi102 ceph-mon[32821]: pgmap v1763: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:35 smithi047 ceph-mon[37680]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:35.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:35 smithi047 ceph-mon[37680]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:35 smithi047 ceph-mon[29365]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:35 smithi047 ceph-mon[29365]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:35 smithi102 ceph-mon[32821]: from='client.24415 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-06T04:09:35.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:35 smithi102 ceph-mon[32821]: from='mgr.14568 172.21.15.47:0/2633740786' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T04:09:36.190 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool delete 221d75c7-d61e-469a-8866-a0e9906e6a82 221d75c7-d61e-469a-8866-a0e9906e6a82 --yes-i-really-really-mean-it 2024-04-06T04:09:36.288 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 -- 172.21.15.47:0/2642125679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef41066d0 msgr2=0x7fdef4106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/2642125679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef41066d0 0x7fdef4106ab0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009930 tx=0x7fdef002bc30 comp rx=0 tx=0).stop 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 -- 172.21.15.47:0/2642125679 shutdown_connections 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/2642125679 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdef4101080 0x7fdef410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/2642125679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef41006c0 0x7fdef4100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/2642125679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef41066d0 0x7fdef4106ab0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 -- 172.21.15.47:0/2642125679 >> 172.21.15.47:0/2642125679 conn(0x7fdef40778c0 msgr2=0x7fdef4077cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 -- 172.21.15.47:0/2642125679 shutdown_connections 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 -- 172.21.15.47:0/2642125679 wait complete. 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.286+0000 7fdefc6b0640 1 Processor -- start 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefc6b0640 1 -- start start 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefc6b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef41006c0 0x7fdef419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:36.289 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefc6b0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4101080 0x7fdef419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefc6b0640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdef41066d0 0x7fdef41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefc6b0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4110200 con 0x7fdef4101080 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefc6b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4110080 con 0x7fdef41006c0 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefc6b0640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fdef4110380 con 0x7fdef41066d0 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefac4d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdef41066d0 0x7fdef41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdef9c4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4101080 0x7fdef419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefac4d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdef41066d0 0x7fdef41997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:46928/0 (socket says 172.21.15.47:46928) 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefac4d640 1 -- 172.21.15.47:0/1345368664 learned_addr learned my addr 172.21.15.47:0/1345368664 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefa44c640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef41006c0 0x7fdef419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdef9c4b640 1 -- 172.21.15.47:0/1345368664 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdef41066d0 msgr2=0x7fdef41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdef9c4b640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdef41066d0 0x7fdef41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdef9c4b640 1 -- 172.21.15.47:0/1345368664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef41006c0 msgr2=0x7fdef419f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:36.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdef9c4b640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef41006c0 0x7fdef419f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:36.291 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdef9c4b640 1 -- 172.21.15.47:0/1345368664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef4199fb0 con 0x7fdef4101080 2024-04-06T04:09:36.291 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdefac4d640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdef41066d0 0x7fdef41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-06T04:09:36.291 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.287+0000 7fdef9c4b640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4101080 0x7fdef419fbb0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c970 tx=0x7fdee400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:09:36.291 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.288+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4007bb0 con 0x7fdef4101080 2024-04-06T04:09:36.291 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.288+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fdee4007d50 con 0x7fdef4101080 2024-04-06T04:09:36.291 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.288+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef419a2a0 con 0x7fdef4101080 2024-04-06T04:09:36.291 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.288+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4004db0 con 0x7fdef4101080 2024-04-06T04:09:36.291 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.288+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef41a64c0 con 0x7fdef4101080 2024-04-06T04:09:36.292 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.289+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef4101e00 con 0x7fdef4101080 2024-04-06T04:09:36.292 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.289+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7fdee4005000 con 0x7fdef4101080 2024-04-06T04:09:36.292 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.290+0000 7fdeeb7fe640 1 --2- 172.21.15.47:0/1345368664 >> v2:172.21.15.47:6800/3359778320 conn(0x7fdee006db70 0x7fdee0070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:36.292 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.290+0000 7fdefa44c640 1 --2- 172.21.15.47:0/1345368664 >> v2:172.21.15.47:6800/3359778320 conn(0x7fdee006db70 0x7fdee0070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:36.292 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.290+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(781..781 src has 254..781) ==== 8206+0+0 (secure 0 0 0) 0x7fdee408e250 con 0x7fdef4101080 2024-04-06T04:09:36.293 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.290+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=782}) -- 0x7fdee0079970 con 0x7fdef4101080 2024-04-06T04:09:36.293 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.290+0000 7fdefa44c640 1 --2- 172.21.15.47:0/1345368664 >> v2:172.21.15.47:6800/3359778320 conn(0x7fdee006db70 0x7fdee0070030 secure :-1 s=READY pgs=3446 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009900 tx=0x7fdef0005fd0 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:09:36.295 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.295+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fdee4061030 con 0x7fdef4101080 2024-04-06T04:09:36.479 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:36.478+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdef419ad40 con 0x7fdef4101080 2024-04-06T04:09:36.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:36 smithi047 ceph-mon[29365]: pgmap v1764: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:09:36.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:36 smithi047 ceph-mon[37680]: pgmap v1764: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:09:36.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:36 smithi102 ceph-mon[32821]: pgmap v1764: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-06T04:09:37.230 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.230+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]=0 pool '221d75c7-d61e-469a-8866-a0e9906e6a82' removed v782) ==== 248+0+0 (secure 0 0 0) 0x7fdef419ad40 con 0x7fdef4101080 2024-04-06T04:09:37.231 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.230+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 8 ==== osd_map(782..782 src has 254..782) ==== 296+0+0 (secure 0 0 0) 0x7fdee40c2280 con 0x7fdef4101080 2024-04-06T04:09:37.231 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.230+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=783}) -- 0x7fdee007a650 con 0x7fdef4101080 2024-04-06T04:09:37.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.349+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdef40fecc0 con 0x7fdef4101080 2024-04-06T04:09:37.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.350+0000 7fdeeb7fe640 1 -- 172.21.15.47:0/1345368664 <== mon.0 v2:172.21.15.47:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]=0 pool '221d75c7-d61e-469a-8866-a0e9906e6a82' does not exist v782) ==== 255+0+0 (secure 0 0 0) 0x7fdee4014030 con 0x7fdef4101080 2024-04-06T04:09:37.351 INFO:tasks.workunit.client.0.smithi047.stderr:pool '221d75c7-d61e-469a-8866-a0e9906e6a82' does not exist 2024-04-06T04:09:37.352 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 >> v2:172.21.15.47:6800/3359778320 conn(0x7fdee006db70 msgr2=0x7fdee0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/1345368664 >> v2:172.21.15.47:6800/3359778320 conn(0x7fdee006db70 0x7fdee0070030 secure :-1 s=READY pgs=3446 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009900 tx=0x7fdef0005fd0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4101080 msgr2=0x7fdef419fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4101080 0x7fdef419fbb0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c970 tx=0x7fdee400ce30 comp rx=0 tx=0).stop 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 shutdown_connections 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/1345368664 >> v2:172.21.15.47:6800/3359778320 conn(0x7fdee006db70 0x7fdee0070030 unknown :-1 s=CLOSED pgs=3446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdef41066d0 0x7fdef41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4101080 0x7fdef419fbb0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 --2- 172.21.15.47:0/1345368664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef41006c0 0x7fdef419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 >> 172.21.15.47:0/1345368664 conn(0x7fdef40778c0 msgr2=0x7fdef410bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 shutdown_connections 2024-04-06T04:09:37.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.352+0000 7fdefc6b0640 1 -- 172.21.15.47:0/1345368664 wait complete. 2024-04-06T04:09:37.361 INFO:tasks.workunit.client.0.smithi047.stderr:+ ceph osd pool delete 432b0d4c-0aa7-47da-b6b8-69d933cee88c 432b0d4c-0aa7-47da-b6b8-69d933cee88c --yes-i-really-really-mean-it 2024-04-06T04:09:37.448 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 -- 172.21.15.47:0/554021749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768105f40 msgr2=0x7f7768106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 --2- 172.21.15.47:0/554021749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768105f40 0x7f7768106320 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f7758009900 tx=0x7f775802bc50 comp rx=0 tx=0).stop 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 -- 172.21.15.47:0/554021749 shutdown_connections 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 --2- 172.21.15.47:0/554021749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7768100af0 0x7f776810cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 --2- 172.21.15.47:0/554021749 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7768100150 0x7f77681005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 --2- 172.21.15.47:0/554021749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768105f40 0x7f7768106320 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 -- 172.21.15.47:0/554021749 >> 172.21.15.47:0/554021749 conn(0x7f77680759c0 msgr2=0x7f7768075dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 -- 172.21.15.47:0/554021749 shutdown_connections 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 -- 172.21.15.47:0/554021749 wait complete. 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.445+0000 7f776d06d640 1 Processor -- start 2024-04-06T04:09:37.449 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776d06d640 1 -- start start 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776d06d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768100150 0x7f7768197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776d06d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7768100af0 0x7f7768197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776d06d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7768105f40 0x7f776819bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776d06d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f776810f080 con 0x7f7768100150 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776d06d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f776810ef00 con 0x7f7768100af0 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776d06d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f776810f200 con 0x7f7768105f40 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768100150 0x7f7768197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776759e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7768105f40 0x7f776819bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768100150 0x7f7768197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53922/0 (socket says 172.21.15.47:53922) 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 -- 172.21.15.47:0/3139823242 learned_addr learned my addr 172.21.15.47:0/3139823242 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776659c640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7768100af0 0x7f7768197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 -- 172.21.15.47:0/3139823242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7768105f40 msgr2=0x7f776819bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:37.450 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7768105f40 0x7f776819bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 -- 172.21.15.47:0/3139823242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7768100af0 msgr2=0x7f7768197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7768100af0 0x7f7768197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 -- 172.21.15.47:0/3139823242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776819c6f0 con 0x7f7768100150 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f776659c640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7768100af0 0x7f7768197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.446+0000 7f7766d9d640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768100150 0x7f7768197700 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f7758005940 tx=0x7f775802c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.447+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758043020 con 0x7f7768100150 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.447+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776819c980 con 0x7f7768100150 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.447+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f77580043d0 con 0x7f7768100150 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.447+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758003ae0 con 0x7f7768100150 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.447+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77681a4270 con 0x7f7768100150 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.448+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7768068b10 con 0x7f7768100150 2024-04-06T04:09:37.451 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.448+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 91794+0+0 (secure 0 0 0) 0x7f7758046020 con 0x7f7768100150 2024-04-06T04:09:37.452 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.449+0000 7f774ffff640 1 --2- 172.21.15.47:0/3139823242 >> v2:172.21.15.47:6800/3359778320 conn(0x7f775006db70 0x7f7750070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-06T04:09:37.452 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.449+0000 7f776659c640 1 --2- 172.21.15.47:0/3139823242 >> v2:172.21.15.47:6800/3359778320 conn(0x7f775006db70 0x7f7750070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T04:09:37.452 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.449+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(782..782 src has 254..782) ==== 7818+0+0 (secure 0 0 0) 0x7f77580afca0 con 0x7f7768100150 2024-04-06T04:09:37.452 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.449+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=783}) -- 0x7f77500790d0 con 0x7f7768100150 2024-04-06T04:09:37.452 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.449+0000 7f776659c640 1 --2- 172.21.15.47:0/3139823242 >> v2:172.21.15.47:6800/3359778320 conn(0x7f775006db70 0x7f7750070030 secure :-1 s=READY pgs=3447 cs=0 l=1 rev1=1 crypto rx=0x7f77680fe730 tx=0x7f775c005f90 comp rx=0 tx=0).ready entity=mgr.14568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T04:09:37.454 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.453+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f775804d070 con 0x7f7768100150 2024-04-06T04:09:37.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:37 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:37.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:37 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:37.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:37 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:37.635 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:37.635+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true} v 0) -- 0x7f776810a340 con 0x7f7768100150 2024-04-06T04:09:38.232 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.232+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]=0 pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' removed v783) ==== 248+0+0 (secure 0 0 0) 0x7f775807d170 con 0x7f7768100150 2024-04-06T04:09:38.233 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.232+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 8 ==== osd_map(783..783 src has 254..783) ==== 296+0+0 (secure 0 0 0) 0x7f77580adaa0 con 0x7f7768100150 2024-04-06T04:09:38.233 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.232+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=784}) -- 0x7f7750079db0 con 0x7f7768100150 2024-04-06T04:09:38.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.352+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7768109db0 con 0x7f7768100150 2024-04-06T04:09:38.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.353+0000 7f774ffff640 1 -- 172.21.15.47:0/3139823242 <== mon.0 v2:172.21.15.47:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]=0 pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' does not exist v783) ==== 255+0+0 (secure 0 0 0) 0x7f7758080bc0 con 0x7f7768100150 2024-04-06T04:09:38.353 INFO:tasks.workunit.client.0.smithi047.stderr:pool '432b0d4c-0aa7-47da-b6b8-69d933cee88c' does not exist 2024-04-06T04:09:38.355 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.354+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 >> v2:172.21.15.47:6800/3359778320 conn(0x7f775006db70 msgr2=0x7f7750070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:38.355 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.354+0000 7f776d06d640 1 --2- 172.21.15.47:0/3139823242 >> v2:172.21.15.47:6800/3359778320 conn(0x7f775006db70 0x7f7750070030 secure :-1 s=READY pgs=3447 cs=0 l=1 rev1=1 crypto rx=0x7f77680fe730 tx=0x7f775c005f90 comp rx=0 tx=0).stop 2024-04-06T04:09:38.355 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.354+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768100150 msgr2=0x7f7768197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T04:09:38.355 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.354+0000 7f776d06d640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768100150 0x7f7768197700 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f7758005940 tx=0x7f775802c7f0 comp rx=0 tx=0).stop 2024-04-06T04:09:38.356 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.355+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 shutdown_connections 2024-04-06T04:09:38.356 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.355+0000 7f776d06d640 1 --2- 172.21.15.47:0/3139823242 >> v2:172.21.15.47:6800/3359778320 conn(0x7f775006db70 0x7f7750070030 unknown :-1 s=CLOSED pgs=3447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:38.356 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.355+0000 7f776d06d640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7768105f40 0x7f776819bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:38.356 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.355+0000 7f776d06d640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7768100af0 0x7f7768197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:38.356 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.355+0000 7f776d06d640 1 --2- 172.21.15.47:0/3139823242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768100150 0x7f7768197700 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-06T04:09:38.356 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.355+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 >> 172.21.15.47:0/3139823242 conn(0x7f77680759c0 msgr2=0x7f77680fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T04:09:38.356 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.355+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 shutdown_connections 2024-04-06T04:09:38.356 INFO:tasks.workunit.client.0.smithi047.stderr:2024-04-06T04:09:38.355+0000 7f776d06d640 1 -- 172.21.15.47:0/3139823242 wait complete. 2024-04-06T04:09:38.364 INFO:tasks.workunit.client.0.smithi047.stdout:OK 2024-04-06T04:09:38.365 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo OK 2024-04-06T04:09:38.365 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-06T04:09:38.366 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-06T04:09:38.434 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-04-06T04:09:38.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-06T04:09:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[37680]: pgmap v1765: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T04:09:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[37680]: osdmap e782: 8 total, 8 up, 8 in 2024-04-06T04:09:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:38.492 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:38.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[29365]: pgmap v1765: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T04:09:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[29365]: osdmap e782: 8 total, 8 up, 8 in 2024-04-06T04:09:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:38.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:38 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:38 smithi102 ceph-mon[32821]: pgmap v1765: 188 pgs: 188 active+clean; 871 KiB data, 827 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T04:09:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T04:09:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:38 smithi102 ceph-mon[32821]: osdmap e782: 8 total, 8 up, 8 in 2024-04-06T04:09:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/1345368664' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "221d75c7-d61e-469a-8866-a0e9906e6a82", "pool2": "221d75c7-d61e-469a-8866-a0e9906e6a82", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:38.583 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:38 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:38.774 DEBUG:teuthology.parallel:result is None 2024-04-06T04:09:38.775 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-06T04:09:38.841 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-06T04:09:38.841 DEBUG:teuthology.orchestra.run.smithi047:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-06T04:09:38.906 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-06T04:09:38.906 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-06T04:09:38.916 INFO:tasks.cephadm:Teardown begin 2024-04-06T04:09:38.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-06T04:09:38.973 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-06T04:09:39.007 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-06T04:09:39.008 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-06T04:09:39.028 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-06T04:09:39.064 INFO:tasks.cephadm:Stopping all daemons... 2024-04-06T04:09:39.064 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-06T04:09:39.064 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a 2024-04-06T04:09:39.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:39 smithi102 ceph-mon[32821]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:09:39.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T04:09:39.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:39 smithi102 ceph-mon[32821]: osdmap e783: 8 total, 8 up, 8 in 2024-04-06T04:09:39.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:39 smithi102 ceph-mon[32821]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:39.367 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 systemd[1]: Stopping Ceph mon.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:09:39.367 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-mon[29365]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:09:39.367 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T04:09:39.367 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-mon[29365]: osdmap e783: 8 total, 8 up, 8 in 2024-04-06T04:09:39.367 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-mon[29365]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:39.367 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-mon[37680]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-06T04:09:39.367 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T04:09:39.368 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-mon[37680]: osdmap e783: 8 total, 8 up, 8 in 2024-04-06T04:09:39.368 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-mon[37680]: from='client.? 172.21.15.47:0/3139823242' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "pool2": "432b0d4c-0aa7-47da-b6b8-69d933cee88c", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T04:09:39.630 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a[29361]: 2024-04-06T04:09:39.365+0000 7fc81b089700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:09:39.630 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a[29361]: 2024-04-06T04:09:39.365+0000 7fc81b089700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-06T04:09:39.630 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:39] ENGINE Bus STOPPING 2024-04-06T04:09:39.630 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:39] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-06T04:09:39.630 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:39] ENGINE Bus STOPPED 2024-04-06T04:09:39.631 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:39] ENGINE Bus STARTING 2024-04-06T04:09:39.631 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:39] ENGINE Serving on http://:::9283 2024-04-06T04:09:39.631 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:39 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:39] ENGINE Bus STARTED 2024-04-06T04:09:39.900 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 podman[152017]: 2024-04-06 04:09:39.630229691 +0000 UTC m=+0.369565362 container stop 7ca29cac51cd7d87880ae2539a25ca09e546f4040365c7ee0224a9990effa7cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-9f19235, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-06T04:09:39.901 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:39 smithi047 podman[152017]: 2024-04-06 04:09:39.656040239 +0000 UTC m=+0.395375906 container died 7ca29cac51cd7d87880ae2539a25ca09e546f4040365c7ee0224a9990effa7cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9f19235, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240403, io.buildah.version=1.33.5) 2024-04-06T04:09:40.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:40 smithi047 podman[152017]: 2024-04-06 04:09:40.049997239 +0000 UTC m=+0.789332897 container cleanup 7ca29cac51cd7d87880ae2539a25ca09e546f4040365c7ee0224a9990effa7cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-9f19235, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403) 2024-04-06T04:09:40.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:40 smithi047 bash[152017]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a 2024-04-06T04:09:40.485 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a.service' 2024-04-06T04:09:40.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:40 smithi047 podman[152108]: 2024-04-06 04:09:40.259663726 +0000 UTC m=+0.624066462 container remove 7ca29cac51cd7d87880ae2539a25ca09e546f4040365c7ee0224a9990effa7cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, RELEASE=squid-9f19235, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-04-06T04:09:40.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:40 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-04-06T04:09:40.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:40 smithi047 systemd[1]: Stopped Ceph mon.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:09:40.511 INFO:journalctl@ceph.mon.a.smithi047.stdout:Apr 06 04:09:40 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.a.service: Consumed 2min 16.127s CPU time. 2024-04-06T04:09:40.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:09:40.525 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-06T04:09:40.525 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-04-06T04:09:40.525 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.c 2024-04-06T04:09:40.872 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:40 smithi047 systemd[1]: Stopping Ceph mon.c for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:09:41.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-c[37676]: 2024-04-06T04:09:40.871+0000 7f88eb511700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:09:41.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-c[37676]: 2024-04-06T04:09:40.871+0000 7f88eb511700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-04-06T04:09:41.242 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:41 smithi047 podman[152239]: 2024-04-06 04:09:41.07612168 +0000 UTC m=+0.331393826 container died e3d2b859de50106042ef482d9d97259e67d0f0caff1b444d41a15f5a3cab24e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-c, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-9f19235, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-06T04:09:41.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:40] ENGINE Bus STOPPING 2024-04-06T04:09:41.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:40] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-06T04:09:41.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:40] ENGINE Bus STOPPED 2024-04-06T04:09:41.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:40] ENGINE Bus STARTING 2024-04-06T04:09:41.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:40] ENGINE Serving on http://:::9283 2024-04-06T04:09:41.243 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:40 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: [06/Apr/2024:04:09:40] ENGINE Bus STARTED 2024-04-06T04:09:41.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:41 smithi047 podman[152239]: 2024-04-06 04:09:41.563095262 +0000 UTC m=+0.818367400 container cleanup e3d2b859de50106042ef482d9d97259e67d0f0caff1b444d41a15f5a3cab24e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-9f19235) 2024-04-06T04:09:41.742 INFO:journalctl@ceph.mon.c.smithi047.stdout:Apr 06 04:09:41 smithi047 bash[152239]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-c 2024-04-06T04:09:41.950 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.c.service' 2024-04-06T04:09:41.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:09:41.987 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-04-06T04:09:41.987 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-04-06T04:09:41.987 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.b 2024-04-06T04:09:42.333 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:42 smithi102 systemd[1]: Stopping Ceph mon.b for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:09:42.637 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b[32817]: 2024-04-06T04:09:42.369+0000 7fab2ac96700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:09:42.638 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b[32817]: 2024-04-06T04:09:42.369+0000 7fab2ac96700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-04-06T04:09:42.638 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:42 smithi102 podman[74965]: 2024-04-06 04:09:42.400747154 +0000 UTC m=+0.218806614 container died 3685eb8a3a6c01baabdb0dbcf99f2bbe5fb370a1b6c72e94bed67867ce75325b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T04:09:43.072 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:42 smithi102 podman[74965]: 2024-04-06 04:09:42.845624644 +0000 UTC m=+0.663684093 container cleanup 3685eb8a3a6c01baabdb0dbcf99f2bbe5fb370a1b6c72e94bed67867ce75325b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-9f19235, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True) 2024-04-06T04:09:43.072 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:42 smithi102 bash[74965]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b 2024-04-06T04:09:43.302 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.b.service' 2024-04-06T04:09:43.326 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:43 smithi102 podman[74979]: 2024-04-06 04:09:43.072127841 +0000 UTC m=+0.667684025 container remove 3685eb8a3a6c01baabdb0dbcf99f2bbe5fb370a1b6c72e94bed67867ce75325b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mon-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-06T04:09:43.326 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:43 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.b.service: Deactivated successfully. 2024-04-06T04:09:43.326 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:43 smithi102 systemd[1]: Stopped Ceph mon.b for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:09:43.327 INFO:journalctl@ceph.mon.b.smithi102.stdout:Apr 06 04:09:43 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mon.b.service: Consumed 31.003s CPU time. 2024-04-06T04:09:43.350 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:09:43.350 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-04-06T04:09:43.350 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-06T04:09:43.351 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.y 2024-04-06T04:09:43.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:09:43 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug there is no tcmu-runner data available 2024-04-06T04:09:43.651 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:43 smithi047 systemd[1]: Stopping Ceph mgr.y for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:09:43.960 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T04:09:43.650+0000 7f71c095d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:09:43.960 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:43 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y[29594]: 2024-04-06T04:09:43.650+0000 7f71c095d700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-06T04:09:43.960 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:43 smithi047 podman[152373]: 2024-04-06 04:09:43.681914528 +0000 UTC m=+0.136150147 container died a233835f566392af95cd4efba5dffdd069305ebd198087f0d5f127f4850faeea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-9f19235, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403) 2024-04-06T04:09:44.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:44 smithi047 podman[152373]: 2024-04-06 04:09:44.05996331 +0000 UTC m=+0.514198936 container cleanup a233835f566392af95cd4efba5dffdd069305ebd198087f0d5f127f4850faeea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9f192350ba5fe6d0a365b251a8c2af61f56a5fa6, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-9f19235, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-06T04:09:44.242 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 06 04:09:44 smithi047 bash[152373]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-y 2024-04-06T04:09:44.550 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.y.service' 2024-04-06T04:09:44.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:09:44.587 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-06T04:09:44.587 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-06T04:09:44.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.x 2024-04-06T04:09:44.923 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 04:09:44 smithi102 systemd[1]: Stopping Ceph mgr.x for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:09:45.217 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 04:09:44 smithi102 podman[75089]: 2024-04-06 04:09:44.923052996 +0000 UTC m=+0.140070662 container died 753d5386e2ee8a32166177879f4fa3bf056136ecdb80e884e8a4a6f0fb13bedd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x, RELEASE=squid-9f19235, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-06T04:09:45.526 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 04:09:45 smithi102 podman[75089]: 2024-04-06 04:09:45.283401257 +0000 UTC m=+0.500418930 container cleanup 753d5386e2ee8a32166177879f4fa3bf056136ecdb80e884e8a4a6f0fb13bedd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-06T04:09:45.526 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Apr 06 04:09:45 smithi102 bash[75089]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-mgr-x 2024-04-06T04:09:45.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@mgr.x.service' 2024-04-06T04:09:45.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:09:45.689 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-06T04:09:45.689 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-06T04:09:45.689 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.0 2024-04-06T04:09:45.992 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:45 smithi047 systemd[1]: Stopping Ceph osd.0 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:09:46.492 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:46 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0[41662]: 2024-04-06T04:09:46.022+0000 7ff47a267700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:09:46.492 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:46 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0[41662]: 2024-04-06T04:09:46.022+0000 7ff47a267700 -1 osd.0 783 *** Got signal Terminated *** 2024-04-06T04:09:46.492 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:46 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0[41662]: 2024-04-06T04:09:46.022+0000 7ff47a267700 -1 osd.0 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:09:51.941 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:51 smithi047 podman[152494]: 2024-04-06 04:09:51.563188166 +0000 UTC m=+5.678394308 container died 6f1ad839462aaaf538a4a9c4d787aa2d47c02155f40e9ee0ac843114ee24be94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-9f19235, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-06T04:09:52.242 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:52 smithi047 podman[152494]: 2024-04-06 04:09:52.014357136 +0000 UTC m=+6.129563274 container cleanup 6f1ad839462aaaf538a4a9c4d787aa2d47c02155f40e9ee0ac843114ee24be94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-06T04:09:52.242 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:52 smithi047 bash[152494]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0 2024-04-06T04:09:52.631 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:52 smithi047 podman[152513]: 2024-04-06 04:09:52.299162968 +0000 UTC m=+0.730116790 container remove 6f1ad839462aaaf538a4a9c4d787aa2d47c02155f40e9ee0ac843114ee24be94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-9f19235, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T04:09:52.886 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:52 smithi047 podman[152603]: 2024-04-06 04:09:52.534854431 +0000 UTC m=+0.017820747 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T04:09:52.886 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:52 smithi047 podman[152603]: 2024-04-06 04:09:52.650023522 +0000 UTC m=+0.132989833 container create ff091ad818cff3fd2983444a7c2471c4b2a20ee2c321c64ee612e1a1579f65ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-04-06T04:09:52.886 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:52 smithi047 podman[152603]: 2024-04-06 04:09:52.886218172 +0000 UTC m=+0.369184481 container init ff091ad818cff3fd2983444a7c2471c4b2a20ee2c321c64ee612e1a1579f65ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-06T04:09:53.186 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:52 smithi047 podman[152603]: 2024-04-06 04:09:52.889643446 +0000 UTC m=+0.372609753 container start ff091ad818cff3fd2983444a7c2471c4b2a20ee2c321c64ee612e1a1579f65ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403) 2024-04-06T04:09:53.186 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:52 smithi047 podman[152603]: 2024-04-06 04:09:52.99461259 +0000 UTC m=+0.477578897 container attach ff091ad818cff3fd2983444a7c2471c4b2a20ee2c321c64ee612e1a1579f65ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, RELEASE=squid-9f19235, ceph=True) 2024-04-06T04:09:53.460 INFO:journalctl@ceph.osd.0.smithi047.stdout:Apr 06 04:09:53 smithi047 podman[152603]: 2024-04-06 04:09:53.186572842 +0000 UTC m=+0.669539152 container died ff091ad818cff3fd2983444a7c2471c4b2a20ee2c321c64ee612e1a1579f65ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T04:09:53.742 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.0.service' 2024-04-06T04:09:53.790 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:09:53.790 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-06T04:09:53.790 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-06T04:09:53.790 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.1 2024-04-06T04:09:53.992 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:09:53 smithi047 systemd[1]: Stopping Ceph osd.1 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:09:54.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:09:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:09:53.778Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:09:54.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:09:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:09:53.779Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:09:54.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:09:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:09:53.781Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:09:54.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:09:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:09:53.781Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:09:54.084 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:09:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:09:53.781Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:09:54.450 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:09:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1[47247]: 2024-04-06T04:09:54.117+0000 7ffa211db700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:09:54.451 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:09:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1[47247]: 2024-04-06T04:09:54.117+0000 7ffa211db700 -1 osd.1 783 *** Got signal Terminated *** 2024-04-06T04:09:54.451 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:09:54 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1[47247]: 2024-04-06T04:09:54.117+0000 7ffa211db700 -1 osd.1 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:09:59.920 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:09:59 smithi047 podman[152721]: 2024-04-06 04:09:59.619305882 +0000 UTC m=+5.635321269 container died 2321437c29451a2311921c25b78df073a6e841216559d850b7c7f5237c013107 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, RELEASE=squid-9f19235, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-06T04:10:00.227 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:00 smithi047 podman[152721]: 2024-04-06 04:10:00.018252127 +0000 UTC m=+6.034267514 container cleanup 2321437c29451a2311921c25b78df073a6e841216559d850b7c7f5237c013107 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, RELEASE=squid-9f19235, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-06T04:10:00.228 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:00 smithi047 bash[152721]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1 2024-04-06T04:10:00.492 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:00 smithi047 podman[152739]: 2024-04-06 04:10:00.227712173 +0000 UTC m=+0.603976124 container remove 2321437c29451a2311921c25b78df073a6e841216559d850b7c7f5237c013107 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-9f19235, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-06T04:10:00.882 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:00 smithi047 podman[152832]: 2024-04-06 04:10:00.534132827 +0000 UTC m=+0.017624607 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T04:10:00.882 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:00 smithi047 podman[152832]: 2024-04-06 04:10:00.653796225 +0000 UTC m=+0.137288024 container create 8020dc1ca6612704a627b5e04b03dbecb837504ef20635293d4ce03d37ad12be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-06T04:10:01.178 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:00 smithi047 podman[152832]: 2024-04-06 04:10:00.88120709 +0000 UTC m=+0.364698844 container init 8020dc1ca6612704a627b5e04b03dbecb837504ef20635293d4ce03d37ad12be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-04-06T04:10:01.178 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:00 smithi047 podman[152832]: 2024-04-06 04:10:00.884529317 +0000 UTC m=+0.368021076 container start 8020dc1ca6612704a627b5e04b03dbecb837504ef20635293d4ce03d37ad12be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T04:10:01.178 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:00 smithi047 podman[152832]: 2024-04-06 04:10:00.989421891 +0000 UTC m=+0.472913659 container attach 8020dc1ca6612704a627b5e04b03dbecb837504ef20635293d4ce03d37ad12be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1-deactivate, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-06T04:10:01.492 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 06 04:10:01 smithi047 podman[152832]: 2024-04-06 04:10:01.17884566 +0000 UTC m=+0.662337428 container died 8020dc1ca6612704a627b5e04b03dbecb837504ef20635293d4ce03d37ad12be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-9f19235, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-06T04:10:01.895 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.1.service' 2024-04-06T04:10:01.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:10:01.942 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-06T04:10:01.942 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-06T04:10:01.943 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.2 2024-04-06T04:10:02.242 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:01 smithi047 systemd[1]: Stopping Ceph osd.2 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:10:02.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:02 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2[53300]: 2024-04-06T04:10:02.279+0000 7feebc7de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:10:02.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:02 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2[53300]: 2024-04-06T04:10:02.279+0000 7feebc7de700 -1 osd.2 783 *** Got signal Terminated *** 2024-04-06T04:10:02.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:02 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2[53300]: 2024-04-06T04:10:02.279+0000 7feebc7de700 -1 osd.2 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:10:08.054 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:07 smithi047 podman[152938]: 2024-04-06 04:10:07.778332215 +0000 UTC m=+5.639218365 container died f33d3ddaf9a4156193c27460d270029b8d80357e1dfeb6abddb24ae3d5a26e58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9f19235, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-06T04:10:08.054 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:08 smithi047 podman[152938]: 2024-04-06 04:10:08.054053447 +0000 UTC m=+5.914939596 container cleanup f33d3ddaf9a4156193c27460d270029b8d80357e1dfeb6abddb24ae3d5a26e58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-9f19235, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403) 2024-04-06T04:10:08.492 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:08 smithi047 bash[152938]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2 2024-04-06T04:10:08.492 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:08 smithi047 podman[152960]: 2024-04-06 04:10:08.28018851 +0000 UTC m=+0.503568369 container remove f33d3ddaf9a4156193c27460d270029b8d80357e1dfeb6abddb24ae3d5a26e58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-06T04:10:08.908 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:08 smithi047 podman[153053]: 2024-04-06 04:10:08.605943272 +0000 UTC m=+0.114781037 container create 5437a3b7bef83f95704f57a732fbf57c25d688f44d1e63964cf30fa81bb6e35d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-06T04:10:08.908 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:08 smithi047 podman[153053]: 2024-04-06 04:10:08.509229153 +0000 UTC m=+0.018066926 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T04:10:08.908 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:08 smithi047 podman[153053]: 2024-04-06 04:10:08.825710914 +0000 UTC m=+0.334548697 container init 5437a3b7bef83f95704f57a732fbf57c25d688f44d1e63964cf30fa81bb6e35d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.build-date=20240403, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-06T04:10:08.908 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:08 smithi047 podman[153053]: 2024-04-06 04:10:08.829174325 +0000 UTC m=+0.338012092 container start 5437a3b7bef83f95704f57a732fbf57c25d688f44d1e63964cf30fa81bb6e35d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2-deactivate, org.label-schema.build-date=20240403, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-06T04:10:08.908 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:08 smithi047 podman[153053]: 2024-04-06 04:10:08.908474816 +0000 UTC m=+0.417312585 container attach 5437a3b7bef83f95704f57a732fbf57c25d688f44d1e63964cf30fa81bb6e35d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, RELEASE=squid-9f19235, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-06T04:10:09.242 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:09 smithi047 podman[153053]: 2024-04-06 04:10:09.126228095 +0000 UTC m=+0.635065862 container died 5437a3b7bef83f95704f57a732fbf57c25d688f44d1e63964cf30fa81bb6e35d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, GIT_CLEAN=True, RELEASE=squid-9f19235) 2024-04-06T04:10:09.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.2.service' 2024-04-06T04:10:09.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:09 smithi047 podman[153079]: 2024-04-06 04:10:09.695157679 +0000 UTC m=+0.563571071 container remove 5437a3b7bef83f95704f57a732fbf57c25d688f44d1e63964cf30fa81bb6e35d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-2-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-06T04:10:09.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:09 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.2.service: Deactivated successfully. 2024-04-06T04:10:09.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:09 smithi047 systemd[1]: Stopped Ceph osd.2 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:10:09.742 INFO:journalctl@ceph.osd.2.smithi047.stdout:Apr 06 04:10:09 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.2.service: Consumed 50.631s CPU time. 2024-04-06T04:10:09.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:10:09.759 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-06T04:10:09.759 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-06T04:10:09.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.3 2024-04-06T04:10:10.073 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:09 smithi047 systemd[1]: Stopping Ceph osd.3 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:10:10.492 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:10 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3[59401]: 2024-04-06T04:10:10.072+0000 7f2a10935700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:10:10.492 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:10 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3[59401]: 2024-04-06T04:10:10.072+0000 7f2a10935700 -1 osd.3 783 *** Got signal Terminated *** 2024-04-06T04:10:10.492 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:10 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3[59401]: 2024-04-06T04:10:10.072+0000 7f2a10935700 -1 osd.3 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:10:13.272 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:12 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:12.897+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:13.583 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:13.511+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:14.198 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:13 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:13.887+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:14.492 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:14 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3[59401]: 2024-04-06T04:10:14.019+0000 7f2a0cf29700 -1 osd.3 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.858196+0000 front 2024-04-06T04:09:48.858392+0000 (oldest deadline 2024-04-06T04:10:13.558242+0000) 2024-04-06T04:10:14.833 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:14 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:14.524+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:14.833 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:14 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:14.756+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:15.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:14 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:14.881+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:15.482 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:15 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3[59401]: 2024-04-06T04:10:15.018+0000 7f2a0cf29700 -1 osd.3 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.858196+0000 front 2024-04-06T04:09:48.858392+0000 (oldest deadline 2024-04-06T04:10:13.558242+0000) 2024-04-06T04:10:15.742 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:15 smithi047 podman[153158]: 2024-04-06 04:10:15.482218621 +0000 UTC m=+5.492343221 container died 7093a7115d89a11d272001163b5b346f36451c9cbbc5ea5705db653caa4af1c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD) 2024-04-06T04:10:15.782 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:15 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:15.437+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:15.782 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:15 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:15.568+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:16.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:15 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:15.920+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:16.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:15 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:15.782+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:16.098 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:15 smithi047 podman[153158]: 2024-04-06 04:10:15.847381083 +0000 UTC m=+5.857505674 container cleanup 7093a7115d89a11d272001163b5b346f36451c9cbbc5ea5705db653caa4af1c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-06T04:10:16.098 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:15 smithi047 bash[153158]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3 2024-04-06T04:10:16.415 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:16 smithi047 podman[153175]: 2024-04-06 04:10:16.098442887 +0000 UTC m=+0.617032335 container remove 7093a7115d89a11d272001163b5b346f36451c9cbbc5ea5705db653caa4af1c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-06T04:10:16.710 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:16 smithi047 podman[153269]: 2024-04-06 04:10:16.318286401 +0000 UTC m=+0.017757631 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T04:10:16.711 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:16 smithi047 podman[153269]: 2024-04-06 04:10:16.425277477 +0000 UTC m=+0.124748740 container create 7f48a17438a15464bac12de2835337430ea2bd56c9c4f4ecdd0eff0519d5a5d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-9f19235, org.label-schema.build-date=20240403) 2024-04-06T04:10:16.711 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:16 smithi047 podman[153269]: 2024-04-06 04:10:16.635807188 +0000 UTC m=+0.335278408 container init 7f48a17438a15464bac12de2835337430ea2bd56c9c4f4ecdd0eff0519d5a5d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-9f19235, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-06T04:10:16.711 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:16 smithi047 podman[153269]: 2024-04-06 04:10:16.638876519 +0000 UTC m=+0.338347737 container start 7f48a17438a15464bac12de2835337430ea2bd56c9c4f4ecdd0eff0519d5a5d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, org.label-schema.license=GPLv2) 2024-04-06T04:10:16.711 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:16 smithi047 podman[153269]: 2024-04-06 04:10:16.710809869 +0000 UTC m=+0.410281103 container attach 7f48a17438a15464bac12de2835337430ea2bd56c9c4f4ecdd0eff0519d5a5d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T04:10:16.755 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:16.414+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:16.755 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:16.547+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:16.992 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:16 smithi047 podman[153269]: 2024-04-06 04:10:16.944070103 +0000 UTC m=+0.643541321 container died 7f48a17438a15464bac12de2835337430ea2bd56c9c4f4ecdd0eff0519d5a5d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-9f19235, GIT_CLEAN=True, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-04-06T04:10:17.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:16.890+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:17.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:16 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:16.755+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:17.490 INFO:journalctl@ceph.osd.3.smithi047.stdout:Apr 06 04:10:17 smithi047 podman[153295]: 2024-04-06 04:10:17.48060818 +0000 UTC m=+0.530961710 container remove 7f48a17438a15464bac12de2835337430ea2bd56c9c4f4ecdd0eff0519d5a5d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235) 2024-04-06T04:10:17.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.3.service' 2024-04-06T04:10:17.535 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:10:17.535 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-06T04:10:17.535 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-06T04:10:17.536 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.4 2024-04-06T04:10:17.805 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:17 smithi102 systemd[1]: Stopping Ceph osd.4 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:10:17.805 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:17.365+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:17.806 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:17.590+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:18.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:17.897+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:18.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:17.805+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:18.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:17.828+0000 7f25d8019700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:10:18.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:17.828+0000 7f25d8019700 -1 osd.4 783 *** Got signal Terminated *** 2024-04-06T04:10:18.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:17 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:17.828+0000 7f25d8019700 -1 osd.4 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:10:18.781 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:18.381+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:18.782 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:18.592+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:19.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:18.908+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:19.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:18 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:18.781+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:19.733 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:19 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:19.421+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:19.734 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:19 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:19.584+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:20.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:19 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:19.907+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:20.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:19 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:19.733+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:20.755 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:20.394+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:20.755 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:20.580+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:21.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:20.918+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:21.084 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:20.755+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:21.084 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:20.755+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:54.741675+0000 front 2024-04-06T04:09:54.741780+0000 (oldest deadline 2024-04-06T04:10:20.041621+0000) 2024-04-06T04:10:21.757 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:21.374+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:21.758 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:21.622+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:22.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:21.957+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:22.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:21.957+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:22.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:21.757+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:22.083 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:21 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:21.757+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:54.741675+0000 front 2024-04-06T04:09:54.741780+0000 (oldest deadline 2024-04-06T04:10:20.041621+0000) 2024-04-06T04:10:22.666 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:22.342+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:22.667 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:22.342+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:22.972 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:22.666+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:22.972 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:22.740+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:45.940420+0000 front 2024-04-06T04:09:45.940558+0000 (oldest deadline 2024-04-06T04:10:14.741107+0000) 2024-04-06T04:10:22.972 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4[37815]: 2024-04-06T04:10:22.740+0000 7f25d0605700 -1 osd.4 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:54.741675+0000 front 2024-04-06T04:09:54.741780+0000 (oldest deadline 2024-04-06T04:10:20.041621+0000) 2024-04-06T04:10:23.327 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:22.971+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:23.327 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:22 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:22.971+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:23.583 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:23 smithi102 podman[75226]: 2024-04-06 04:10:23.336386488 +0000 UTC m=+5.600403733 container died 3ce6cff558936335fecebce444159739e85020e7380b3ebb495047722957ad09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-9f19235, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-06T04:10:23.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:23.325+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:23.584 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:23.325+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:23.927 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:23.652+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:23.927 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:23 smithi102 podman[75226]: 2024-04-06 04:10:23.694680081 +0000 UTC m=+5.958697341 container cleanup 3ce6cff558936335fecebce444159739e85020e7380b3ebb495047722957ad09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235) 2024-04-06T04:10:23.927 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:23 smithi102 bash[75226]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4 2024-04-06T04:10:24.271 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:23.925+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:24.271 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:23 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:23.925+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:24.271 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:24 smithi102 podman[75243]: 2024-04-06 04:10:24.012805868 +0000 UTC m=+0.671878604 container remove 3ce6cff558936335fecebce444159739e85020e7380b3ebb495047722957ad09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4, ceph=True, org.label-schema.build-date=20240403, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-06T04:10:24.532 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:24.307+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:24.532 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:24.307+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:24.532 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:24 smithi102 podman[75337]: 2024-04-06 04:10:24.25877947 +0000 UTC m=+0.018690052 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T04:10:24.533 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:24 smithi102 podman[75337]: 2024-04-06 04:10:24.380472539 +0000 UTC m=+0.140383111 container create b1f87b544111226b1f593d288d243fecc6d0ab9264ec318a22700abf6525c61d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T04:10:24.833 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:24.633+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:24.833 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:24.633+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:24.833 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:24 smithi102 podman[75337]: 2024-04-06 04:10:24.616351396 +0000 UTC m=+0.376261972 container init b1f87b544111226b1f593d288d243fecc6d0ab9264ec318a22700abf6525c61d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4-deactivate, RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-06T04:10:24.833 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:24 smithi102 podman[75337]: 2024-04-06 04:10:24.619402608 +0000 UTC m=+0.379313184 container start b1f87b544111226b1f593d288d243fecc6d0ab9264ec318a22700abf6525c61d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9f19235, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403) 2024-04-06T04:10:24.833 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:24 smithi102 podman[75337]: 2024-04-06 04:10:24.707809913 +0000 UTC m=+0.467720498 container attach b1f87b544111226b1f593d288d243fecc6d0ab9264ec318a22700abf6525c61d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-06T04:10:25.269 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:24.893+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:25.269 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:24 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:24.893+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:25.269 INFO:journalctl@ceph.osd.4.smithi102.stdout:Apr 06 04:10:24 smithi102 podman[75337]: 2024-04-06 04:10:24.916590134 +0000 UTC m=+0.676500709 container died b1f87b544111226b1f593d288d243fecc6d0ab9264ec318a22700abf6525c61d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-9f19235, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-06T04:10:25.545 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:25.296+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:25.545 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:25.296+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:25.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.4.service' 2024-04-06T04:10:25.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:10:25.605 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-06T04:10:25.605 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-06T04:10:25.605 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.5 2024-04-06T04:10:25.833 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:25 smithi102 systemd[1]: Stopping Ceph osd.5 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:10:25.833 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:25.624+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:25.833 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:25.624+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:26.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:25.931+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:26.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:25.931+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:26.333 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:25.973+0000 7faa93d0e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:10:26.334 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:25.973+0000 7faa93d0e700 -1 osd.5 783 *** Got signal Terminated *** 2024-04-06T04:10:26.334 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:25 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:25.973+0000 7faa93d0e700 -1 osd.5 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:10:26.673 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:26.342+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:26.674 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:26.342+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:26.937 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:26.672+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:26.937 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:26.672+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:27.320 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:26.936+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:27.320 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:26 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:26.936+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:27.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:27.318+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:27.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:27.318+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:27.980 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:27.708+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:27.980 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:27.708+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:28.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:27.979+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:28.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:27 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:27.979+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:28.749 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:28.338+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:28.749 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:28.338+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:29.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:28.748+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:29.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:28.748+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:29.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:28.748+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:29.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:28.933+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:29.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:28 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:28.933+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:29.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:29.300+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:29.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:29.300+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:29.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:29.300+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.453871+0000 front 2024-04-06T04:10:04.453857+0000 (oldest deadline 2024-04-06T04:10:29.153815+0000) 2024-04-06T04:10:29.965 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:29.708+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:29.965 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:29.708+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:29.966 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:29.708+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:30.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:29.965+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:30.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:29 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:29.965+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:30.751 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:30.343+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:30.751 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:30.343+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:30.751 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:30.343+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.453871+0000 front 2024-04-06T04:10:04.453857+0000 (oldest deadline 2024-04-06T04:10:29.153815+0000) 2024-04-06T04:10:31.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:30.750+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:31.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:30.750+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:31.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:30.750+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:31.084 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:30.940+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:31.084 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:30 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:30.940+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:31.516 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: *** Caught signal (Segmentation fault) ** 2024-04-06T04:10:31.516 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: in thread 7faa7aad7700 thread_name:safe_timer 2024-04-06T04:10:31.516 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev) 2024-04-06T04:10:31.516 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faa9b164d20] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2: (BlueStore::_txc_create(BlueStore::Collection*, BlueStore::OpSequencer*, std::__cxx11::list >*, boost::intrusive_ptr)+0x40a) [0x555797c6cdca] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 3: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x1f8) [0x555797cfa968] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 4: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x53) [0x5557978e0733] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 5: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0x7b1) [0x555797b6b841] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 6: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x424) [0x55579785c414] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 7: (PrimaryLogPG::simple_opc_submit(std::unique_ptr >)+0x5a) [0x55579785e47a] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 8: (PrimaryLogPG::handle_watch_timeout(std::shared_ptr)+0x873) [0x5557978603e3] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 9: (HandleWatchTimeout::complete(int)+0x11a) [0x5557977c179a] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 10: (CommonSafeTimer::timer_thread()+0x155) [0x555797e1c735] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 11: (CommonSafeTimerThread::entry()+0x11) [0x555797e1df61] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7faa9b15a1ca] 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 13: clone() 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:31.134+0000 7faa7aad7700 -1 *** Caught signal (Segmentation fault) ** 2024-04-06T04:10:31.517 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: in thread 7faa7aad7700 thread_name:safe_timer 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev) 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faa9b164d20] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2: (BlueStore::_txc_create(BlueStore::Collection*, BlueStore::OpSequencer*, std::__cxx11::list >*, boost::intrusive_ptr)+0x40a) [0x555797c6cdca] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 3: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x1f8) [0x555797cfa968] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 4: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x53) [0x5557978e0733] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 5: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0x7b1) [0x555797b6b841] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 6: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x424) [0x55579785c414] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 7: (PrimaryLogPG::simple_opc_submit(std::unique_ptr >)+0x5a) [0x55579785e47a] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 8: (PrimaryLogPG::handle_watch_timeout(std::shared_ptr)+0x873) [0x5557978603e3] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 9: (HandleWatchTimeout::complete(int)+0x11a) [0x5557977c179a] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 10: (CommonSafeTimer::timer_thread()+0x155) [0x555797e1c735] 2024-04-06T04:10:31.518 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 11: (CommonSafeTimerThread::entry()+0x11) [0x555797e1df61] 2024-04-06T04:10:31.519 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7faa9b15a1ca] 2024-04-06T04:10:31.519 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 13: clone() 2024-04-06T04:10:31.519 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-06T04:10:31.519 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:31.519 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -3361> 2024-04-06T04:10:15.437+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.519 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -2921> 2024-04-06T04:10:16.414+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.519 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -2729> 2024-04-06T04:10:17.365+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.519 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -2643> 2024-04-06T04:10:18.381+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -2371> 2024-04-06T04:10:19.421+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -2262> 2024-04-06T04:10:20.394+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1911> 2024-04-06T04:10:21.374+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1785> 2024-04-06T04:10:22.342+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1784> 2024-04-06T04:10:22.342+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1521> 2024-04-06T04:10:23.325+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1520> 2024-04-06T04:10:23.325+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1191> 2024-04-06T04:10:24.307+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1190> 2024-04-06T04:10:24.307+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.520 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1009> 2024-04-06T04:10:25.296+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -1008> 2024-04-06T04:10:25.296+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -975> 2024-04-06T04:10:25.973+0000 7faa93d0e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -974> 2024-04-06T04:10:25.973+0000 7faa93d0e700 -1 osd.5 783 *** Got signal Terminated *** 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -972> 2024-04-06T04:10:25.973+0000 7faa93d0e700 -1 osd.5 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -940> 2024-04-06T04:10:26.342+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -939> 2024-04-06T04:10:26.342+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -647> 2024-04-06T04:10:27.318+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -646> 2024-04-06T04:10:27.318+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -566> 2024-04-06T04:10:28.338+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -565> 2024-04-06T04:10:28.338+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.521 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -413> 2024-04-06T04:10:29.300+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -412> 2024-04-06T04:10:29.300+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -411> 2024-04-06T04:10:29.300+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.453871+0000 front 2024-04-06T04:10:04.453857+0000 (oldest deadline 2024-04-06T04:10:29.153815+0000) 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -322> 2024-04-06T04:10:30.343+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:48.651899+0000 front 2024-04-06T04:09:48.651888+0000 (oldest deadline 2024-04-06T04:10:14.551769+0000) 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -321> 2024-04-06T04:10:30.343+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:57.453145+0000 front 2024-04-06T04:09:57.453068+0000 (oldest deadline 2024-04-06T04:10:22.152866+0000) 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: -320> 2024-04-06T04:10:30.343+0000 7faa8c2fa700 -1 osd.5 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.453871+0000 front 2024-04-06T04:10:04.453857+0000 (oldest deadline 2024-04-06T04:10:29.153815+0000) 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 0> 2024-04-06T04:10:31.134+0000 7faa7aad7700 -1 *** Caught signal (Segmentation fault) ** 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: in thread 7faa7aad7700 thread_name:safe_timer 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: ceph version 19.0.0-2027-g9f192350 (9f192350ba5fe6d0a365b251a8c2af61f56a5fa6) squid (dev) 2024-04-06T04:10:31.522 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faa9b164d20] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2: (BlueStore::_txc_create(BlueStore::Collection*, BlueStore::OpSequencer*, std::__cxx11::list >*, boost::intrusive_ptr)+0x40a) [0x555797c6cdca] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 3: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x1f8) [0x555797cfa968] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 4: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x53) [0x5557978e0733] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 5: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0x7b1) [0x555797b6b841] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 6: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x424) [0x55579785c414] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 7: (PrimaryLogPG::simple_opc_submit(std::unique_ptr >)+0x5a) [0x55579785e47a] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 8: (PrimaryLogPG::handle_watch_timeout(std::shared_ptr)+0x873) [0x5557978603e3] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 9: (HandleWatchTimeout::complete(int)+0x11a) [0x5557977c179a] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 10: (CommonSafeTimer::timer_thread()+0x155) [0x555797e1c735] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 11: (CommonSafeTimerThread::entry()+0x11) [0x555797e1df61] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7faa9b15a1ca] 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 13: clone() 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-06T04:10:31.523 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5[43317]: 2024-04-06T04:10:31.524 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 podman[75444]: 2024-04-06 04:10:31.231059043 +0000 UTC m=+5.379799628 container died 1d09dd6c037dbc586892ce7c00e17f731a4663bc1373e12ff46b58817b6364d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-06T04:10:31.834 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 podman[75444]: 2024-04-06 04:10:31.640339264 +0000 UTC m=+5.789079841 container cleanup 1d09dd6c037dbc586892ce7c00e17f731a4663bc1373e12ff46b58817b6364d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-06T04:10:31.834 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 bash[75444]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5 2024-04-06T04:10:31.835 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:31.745+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:31.835 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:31.745+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:31.835 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:31.745+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:32.250 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 podman[75471]: 2024-04-06 04:10:31.841460039 +0000 UTC m=+0.614234580 container remove 1d09dd6c037dbc586892ce7c00e17f731a4663bc1373e12ff46b58817b6364d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235, ceph=True, GIT_CLEAN=True) 2024-04-06T04:10:32.250 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:31 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.5.service: Main process exited, code=exited, status=139/n/a 2024-04-06T04:10:32.250 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:31.930+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:32.251 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:31 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:31.930+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:32.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:32 smithi102 podman[75558]: 2024-04-06 04:10:32.153827536 +0000 UTC m=+0.017812901 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T04:10:32.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:32 smithi102 podman[75558]: 2024-04-06 04:10:32.270042306 +0000 UTC m=+0.134027707 container create 1d1ccf0220538d5e8b10eef13c7b40eac2cdf7681654bee0b0d474b9ce3e1de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-9f19235, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-06T04:10:32.583 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:32 smithi102 podman[75558]: 2024-04-06 04:10:32.436921089 +0000 UTC m=+0.300906447 container init 1d1ccf0220538d5e8b10eef13c7b40eac2cdf7681654bee0b0d474b9ce3e1de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5-deactivate, RELEASE=squid-9f19235, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-06T04:10:32.584 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:32 smithi102 podman[75558]: 2024-04-06 04:10:32.440064841 +0000 UTC m=+0.304050211 container start 1d1ccf0220538d5e8b10eef13c7b40eac2cdf7681654bee0b0d474b9ce3e1de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-9f19235, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True) 2024-04-06T04:10:32.584 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:32 smithi102 podman[75558]: 2024-04-06 04:10:32.495175603 +0000 UTC m=+0.359160979 container attach 1d1ccf0220538d5e8b10eef13c7b40eac2cdf7681654bee0b0d474b9ce3e1de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-06T04:10:33.014 INFO:journalctl@ceph.osd.5.smithi102.stdout:Apr 06 04:10:32 smithi102 podman[75558]: 2024-04-06 04:10:32.730819279 +0000 UTC m=+0.594804637 container died 1d1ccf0220538d5e8b10eef13c7b40eac2cdf7681654bee0b0d474b9ce3e1de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-06T04:10:33.015 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:32.909+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:33.015 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:32.909+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:33.015 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:32.909+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:06.173297+0000 front 2024-04-06T04:10:06.173208+0000 (oldest deadline 2024-04-06T04:10:32.073145+0000) 2024-04-06T04:10:33.016 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:32.777+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:33.016 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:32.777+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:33.016 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:32 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:32.778+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:33.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.5.service' 2024-04-06T04:10:33.341 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:10:33.342 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-06T04:10:33.342 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-06T04:10:33.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.6 2024-04-06T04:10:33.582 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:33 smithi102 systemd[1]: Stopping Ceph osd.6 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:10:34.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:33.786+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:34.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:33.786+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:34.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:33.786+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:34.084 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:33.700+0000 7f791c96d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:10:34.084 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:33.700+0000 7f791c96d700 -1 osd.6 783 *** Got signal Terminated *** 2024-04-06T04:10:34.084 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:33.700+0000 7f791c96d700 -1 osd.6 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:10:34.084 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:33.878+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:34.084 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:33.878+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:34.084 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:33 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:33.878+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:06.173297+0000 front 2024-04-06T04:10:06.173208+0000 (oldest deadline 2024-04-06T04:10:32.073145+0000) 2024-04-06T04:10:35.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:34 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:34.881+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:35.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:34 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:34.881+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:35.083 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:34 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:34.881+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:06.173297+0000 front 2024-04-06T04:10:06.173208+0000 (oldest deadline 2024-04-06T04:10:32.073145+0000) 2024-04-06T04:10:35.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:34 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:34.827+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:35.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:34 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:34.827+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:35.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:34 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:34.827+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:36.276 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:35 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:35.836+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:36.277 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:35 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:35.836+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:36.277 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:35 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:35.836+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:36.277 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:35 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:35.899+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:36.277 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:35 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:35.899+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:36.277 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:35 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:35.899+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:06.173297+0000 front 2024-04-06T04:10:06.173208+0000 (oldest deadline 2024-04-06T04:10:32.073145+0000) 2024-04-06T04:10:37.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:36 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:36.899+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:37.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:36 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:36.899+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:37.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:36 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:36.899+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:06.173297+0000 front 2024-04-06T04:10:06.173208+0000 (oldest deadline 2024-04-06T04:10:32.073145+0000) 2024-04-06T04:10:37.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:36 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:36.899+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:14.373956+0000 front 2024-04-06T04:10:14.373979+0000 (oldest deadline 2024-04-06T04:10:36.073951+0000) 2024-04-06T04:10:37.334 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:36 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:36.872+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:37.334 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:36 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:36.872+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:37.334 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:36 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:36.872+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:37.334 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:36 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:36.873+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:38.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:37 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:37.935+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:49.771358+0000 front 2024-04-06T04:09:49.771393+0000 (oldest deadline 2024-04-06T04:10:12.071306+0000) 2024-04-06T04:10:38.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:37 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:37.935+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:56.772443+0000 front 2024-04-06T04:09:56.772400+0000 (oldest deadline 2024-04-06T04:10:21.472130+0000) 2024-04-06T04:10:38.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:37 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:37.935+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:06.173297+0000 front 2024-04-06T04:10:06.173208+0000 (oldest deadline 2024-04-06T04:10:32.073145+0000) 2024-04-06T04:10:38.333 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:37 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6[49321]: 2024-04-06T04:10:37.935+0000 7f7918f61700 -1 osd.6 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:14.373956+0000 front 2024-04-06T04:10:14.373979+0000 (oldest deadline 2024-04-06T04:10:36.073951+0000) 2024-04-06T04:10:38.334 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:37 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:37.912+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:38.334 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:37 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:37.912+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:38.334 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:37 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:37.912+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:38.334 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:37 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:37.912+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:39.307 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:39 smithi102 podman[75667]: 2024-04-06 04:10:39.027362279 +0000 UTC m=+5.461400762 container died 19d34b2d8f22f31ad6159634caaac2855cc3cd6cdb4e62152028969cca0b7380 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-9f19235, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-06T04:10:39.308 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:38.920+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:39.308 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:38.920+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:39.308 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:38.920+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:39.308 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:38 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:38.920+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:39.583 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:39 smithi102 podman[75667]: 2024-04-06 04:10:39.39330023 +0000 UTC m=+5.827338700 container cleanup 19d34b2d8f22f31ad6159634caaac2855cc3cd6cdb4e62152028969cca0b7380 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-9f19235, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2) 2024-04-06T04:10:39.583 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:39 smithi102 bash[75667]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6 2024-04-06T04:10:39.953 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:39 smithi102 podman[75685]: 2024-04-06 04:10:39.627774384 +0000 UTC m=+0.603545509 container remove 19d34b2d8f22f31ad6159634caaac2855cc3cd6cdb4e62152028969cca0b7380 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-9f19235) 2024-04-06T04:10:40.231 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:39 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:39.969+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:40.231 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:39 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:39.969+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:40.231 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:39 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:39.969+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:40.231 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:39 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:39.969+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:13.944327+0000 front 2024-04-06T04:10:13.944344+0000 (oldest deadline 2024-04-06T04:10:39.244343+0000) 2024-04-06T04:10:40.231 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:39 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:39.969+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:40.231 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:39 smithi102 podman[75780]: 2024-04-06 04:10:39.953500997 +0000 UTC m=+0.114684913 container create aaf86ec6f6b039ba4a688d864f3b2f5b881ca5567f859ada3ad46a17cfc37f18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6-deactivate, RELEASE=squid-9f19235, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-06T04:10:40.232 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:39 smithi102 podman[75780]: 2024-04-06 04:10:39.856601963 +0000 UTC m=+0.017785856 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T04:10:40.232 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:40 smithi102 podman[75780]: 2024-04-06 04:10:40.155881025 +0000 UTC m=+0.317064897 container init aaf86ec6f6b039ba4a688d864f3b2f5b881ca5567f859ada3ad46a17cfc37f18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-06T04:10:40.232 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:40 smithi102 podman[75780]: 2024-04-06 04:10:40.158886671 +0000 UTC m=+0.320070555 container start aaf86ec6f6b039ba4a688d864f3b2f5b881ca5567f859ada3ad46a17cfc37f18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-06T04:10:40.232 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:40 smithi102 podman[75780]: 2024-04-06 04:10:40.23090935 +0000 UTC m=+0.392093234 container attach aaf86ec6f6b039ba4a688d864f3b2f5b881ca5567f859ada3ad46a17cfc37f18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-9f19235, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-06T04:10:40.583 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:40 smithi102 podman[75780]: 2024-04-06 04:10:40.442170521 +0000 UTC m=+0.603354388 container died aaf86ec6f6b039ba4a688d864f3b2f5b881ca5567f859ada3ad46a17cfc37f18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-04-06T04:10:40.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.6.service' 2024-04-06T04:10:40.987 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:40 smithi102 podman[75805]: 2024-04-06 04:10:40.934350687 +0000 UTC m=+0.483321308 container remove aaf86ec6f6b039ba4a688d864f3b2f5b881ca5567f859ada3ad46a17cfc37f18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, RELEASE=squid-9f19235, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS) 2024-04-06T04:10:40.987 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:40 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.6.service: Deactivated successfully. 2024-04-06T04:10:40.987 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:40 smithi102 systemd[1]: Stopped Ceph osd.6 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:10:40.987 INFO:journalctl@ceph.osd.6.smithi102.stdout:Apr 06 04:10:40 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.6.service: Consumed 48.130s CPU time. 2024-04-06T04:10:40.987 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:40 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:40.927+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:40.987 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:40 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:40.927+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:40.988 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:40 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:40.927+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:40.988 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:40 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:40.927+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:13.944327+0000 front 2024-04-06T04:10:13.944344+0000 (oldest deadline 2024-04-06T04:10:39.244343+0000) 2024-04-06T04:10:40.988 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:40 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:40.927+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:41.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:10:41.003 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-06T04:10:41.003 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-06T04:10:41.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.7 2024-04-06T04:10:41.329 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 systemd[1]: Stopping Ceph osd.7 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:10:41.583 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:41.328+0000 7fe4bb0e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:10:41.583 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:41.328+0000 7fe4bb0e5700 -1 osd.7 783 *** Got signal Terminated *** 2024-04-06T04:10:41.583 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:41.328+0000 7fe4bb0e5700 -1 osd.7 783 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T04:10:42.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:41.945+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:42.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:41.945+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:42.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:41.945+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:42.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:41.945+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:13.944327+0000 front 2024-04-06T04:10:13.944344+0000 (oldest deadline 2024-04-06T04:10:39.244343+0000) 2024-04-06T04:10:42.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:41 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:41.945+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:43.235 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:42.973+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:43.235 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:42.973+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:43.235 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:42.973+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:43.235 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:42.973+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:13.944327+0000 front 2024-04-06T04:10:13.944344+0000 (oldest deadline 2024-04-06T04:10:39.244343+0000) 2024-04-06T04:10:43.235 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:42 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:42.973+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:44.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:44 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:44.015+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:44.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:44 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:44.015+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:44.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:44 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:44.015+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:44.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:44 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:44.015+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:13.944327+0000 front 2024-04-06T04:10:13.944344+0000 (oldest deadline 2024-04-06T04:10:39.244343+0000) 2024-04-06T04:10:44.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:44 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:44.015+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:45.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:45 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:45.017+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:45.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:45 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:45.017+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:45.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:45 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:45.017+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:45.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:45 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:45.017+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:13.944327+0000 front 2024-04-06T04:10:13.944344+0000 (oldest deadline 2024-04-06T04:10:39.244343+0000) 2024-04-06T04:10:45.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:45 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:45.017+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:46.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:46 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:46.034+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6803 osd.0 since back 2024-04-06T04:09:47.541703+0000 front 2024-04-06T04:09:47.541560+0000 (oldest deadline 2024-04-06T04:10:12.841571+0000) 2024-04-06T04:10:46.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:46 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:46.034+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6807 osd.1 since back 2024-04-06T04:09:58.742512+0000 front 2024-04-06T04:09:58.742666+0000 (oldest deadline 2024-04-06T04:10:24.042677+0000) 2024-04-06T04:10:46.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:46 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:46.034+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6811 osd.2 since back 2024-04-06T04:10:04.043214+0000 front 2024-04-06T04:10:04.043301+0000 (oldest deadline 2024-04-06T04:10:28.143060+0000) 2024-04-06T04:10:46.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:46 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:46.034+0000 7fe4b76d9700 -1 osd.7 783 heartbeat_check: no reply from 172.21.15.47:6815 osd.3 since back 2024-04-06T04:10:13.944327+0000 front 2024-04-06T04:10:13.944344+0000 (oldest deadline 2024-04-06T04:10:39.244343+0000) 2024-04-06T04:10:46.333 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:46 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7[55018]: 2024-04-06T04:10:46.034+0000 7fe4b76d9700 -1 osd.7 783 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24418.0:2161 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e783) 2024-04-06T04:10:47.155 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:46 smithi102 podman[75884]: 2024-04-06 04:10:46.871382112 +0000 UTC m=+5.644460902 container died 24b70ca49e3b1e097875c92e589ad304eed79c86cc7090c39e356a0e1e3cd106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, RELEASE=squid-9f19235, GIT_CLEAN=True) 2024-04-06T04:10:47.505 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:47 smithi102 podman[75884]: 2024-04-06 04:10:47.253754306 +0000 UTC m=+6.026833092 container cleanup 24b70ca49e3b1e097875c92e589ad304eed79c86cc7090c39e356a0e1e3cd106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-04-06T04:10:47.505 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:47 smithi102 bash[75884]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7 2024-04-06T04:10:47.822 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:47 smithi102 podman[75914]: 2024-04-06 04:10:47.504677103 +0000 UTC m=+0.627714076 container remove 24b70ca49e3b1e097875c92e589ad304eed79c86cc7090c39e356a0e1e3cd106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-9f19235, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403) 2024-04-06T04:10:48.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:47 smithi102 podman[76011]: 2024-04-06 04:10:47.725447777 +0000 UTC m=+0.018071335 image pull a5511c7deba913038976ce236d2528051568e0aa5cd4df4989ad160a0a4c3880 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c 2024-04-06T04:10:48.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:47 smithi102 podman[76011]: 2024-04-06 04:10:47.82227968 +0000 UTC m=+0.114903274 container create 5363899cc959f531173b483d71d3592ca54df3d1fb35bc701aeb75ece39b5aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7-deactivate, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T04:10:48.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:48 smithi102 podman[76011]: 2024-04-06 04:10:48.041433042 +0000 UTC m=+0.334056584 container init 5363899cc959f531173b483d71d3592ca54df3d1fb35bc701aeb75ece39b5aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-06T04:10:48.083 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:48 smithi102 podman[76011]: 2024-04-06 04:10:48.044369739 +0000 UTC m=+0.336993282 container start 5363899cc959f531173b483d71d3592ca54df3d1fb35bc701aeb75ece39b5aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-9f19235, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD) 2024-04-06T04:10:48.583 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:48 smithi102 podman[76011]: 2024-04-06 04:10:48.124865228 +0000 UTC m=+0.417488777 container attach 5363899cc959f531173b483d71d3592ca54df3d1fb35bc701aeb75ece39b5aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-9f19235, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-06T04:10:48.583 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:48 smithi102 podman[76011]: 2024-04-06 04:10:48.335901381 +0000 UTC m=+0.628524924 container died 5363899cc959f531173b483d71d3592ca54df3d1fb35bc701aeb75ece39b5aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-9f19235, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-06T04:10:48.877 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.7.service' 2024-04-06T04:10:48.904 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:48 smithi102 podman[76037]: 2024-04-06 04:10:48.861222228 +0000 UTC m=+0.515860325 container remove 5363899cc959f531173b483d71d3592ca54df3d1fb35bc701aeb75ece39b5aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240403, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-9f19235, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-06T04:10:48.904 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:48 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.7.service: Deactivated successfully. 2024-04-06T04:10:48.905 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:48 smithi102 systemd[1]: Stopped Ceph osd.7 for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:10:48.905 INFO:journalctl@ceph.osd.7.smithi102.stdout:Apr 06 04:10:48 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@osd.7.service: Consumed 51.718s CPU time. 2024-04-06T04:10:48.921 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:10:48.921 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-06T04:10:48.921 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-04-06T04:10:48.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@rgw.foo.a 2024-04-06T04:10:49.222 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 04:10:48 smithi047 systemd[1]: Stopping Ceph rgw.foo.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:10:49.492 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 04:10:49 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-rgw-foo-a[64094]: 2024-04-06T04:10:49.221+0000 7ff18f4e4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T04:10:49.492 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 04:10:49 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-rgw-foo-a[64094]: 2024-04-06T04:10:49.221+0000 7ff19dd62ac0 -1 shutting down 2024-04-06T04:10:54.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:10:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:10:53.778Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:10:54.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:10:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:10:53.779Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:10:54.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:10:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:10:53.781Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:10:54.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:10:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:10:53.781Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:10:54.084 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:10:53 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:10:53.781Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.47:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.47:8765: connect: connection refused" 2024-04-06T04:10:59.492 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 04:10:59 smithi047 bash[153375]: time="2024-04-06T04:10:59Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2024-04-06T04:10:59.493 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 04:10:59 smithi047 podman[153375]: 2024-04-06 04:10:59.244728814 +0000 UTC m=+10.130879021 container died 22b1a13ee6a69e1f792baec461fd5e7c35c0cf2e8a9bdd088cf1bf0b9441dfb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-rgw-foo-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5) 2024-04-06T04:10:59.935 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 04:10:59 smithi047 podman[153375]: 2024-04-06 04:10:59.704794366 +0000 UTC m=+10.590944568 container cleanup 22b1a13ee6a69e1f792baec461fd5e7c35c0cf2e8a9bdd088cf1bf0b9441dfb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-rgw-foo-a, RELEASE=squid-9f19235, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-06T04:10:59.935 INFO:journalctl@ceph.rgw.foo.a.smithi047.stdout:Apr 06 04:10:59 smithi047 bash[153375]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-rgw-foo-a 2024-04-06T04:11:00.121 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@rgw.foo.a.service' 2024-04-06T04:11:00.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:11:00.160 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-04-06T04:11:00.160 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-04-06T04:11:00.160 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@prometheus.a 2024-04-06T04:11:00.463 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 systemd[1]: Stopping Ceph prometheus.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:11:00.730 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.463Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.467Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.467Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a[64808]: ts=2024-04-06T04:11:00.467Z caller=main.go:1147 level=info msg="See you next time!" 2024-04-06T04:11:00.731 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 podman[76116]: 2024-04-06 04:11:00.473557016 +0000 UTC m=+0.115499919 container died d6e1677b94e49586b86ba1a69aa95959ec9bcbb67ae989f3e09763ed2128d229 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-04-06T04:11:01.082 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 podman[76116]: 2024-04-06 04:11:00.838131181 +0000 UTC m=+0.480074082 container cleanup d6e1677b94e49586b86ba1a69aa95959ec9bcbb67ae989f3e09763ed2128d229 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-04-06T04:11:01.083 INFO:journalctl@ceph.prometheus.a.smithi102.stdout:Apr 06 04:11:00 smithi102 bash[76116]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-prometheus-a 2024-04-06T04:11:01.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@prometheus.a.service' 2024-04-06T04:11:01.259 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T04:11:01.260 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-04-06T04:11:01.260 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm rm-cluster --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 --force --keep-logs 2024-04-06T04:11:01.454 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T04:11:03.242 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:03 smithi047 systemd[1]: Stopping Ceph alertmanager.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:11:03.611 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:03 smithi047 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a[73750]: ts=2024-04-06T04:11:03.284Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-04-06T04:11:03.611 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:03 smithi047 podman[153883]: 2024-04-06 04:11:03.3258192 +0000 UTC m=+0.148109095 container died e003083d9a03c84adaf832490343c051583aff8dcc7c3131c9a59e8258b8f371 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T04:11:03.992 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:03 smithi047 podman[153883]: 2024-04-06 04:11:03.701768107 +0000 UTC m=+0.524057999 container cleanup e003083d9a03c84adaf832490343c051583aff8dcc7c3131c9a59e8258b8f371 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T04:11:03.992 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:03 smithi047 bash[153883]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a 2024-04-06T04:11:04.369 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:04 smithi047 podman[153897]: 2024-04-06 04:11:04.094668537 +0000 UTC m=+0.764000620 container remove e003083d9a03c84adaf832490343c051583aff8dcc7c3131c9a59e8258b8f371 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-04-06T04:11:04.369 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:04 smithi047 podman[153897]: 2024-04-06 04:11:04.17040171 +0000 UTC m=+0.839733748 volume remove e01c6e7938eff51c568e1ab7571950ee9ab1977917f6ca9b2be5a767f58eacef 2024-04-06T04:11:04.742 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:04 smithi047 systemd[1]: Stopping Ceph node-exporter.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:11:04.742 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:04 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-04-06T04:11:04.742 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:04 smithi047 systemd[1]: Stopped Ceph alertmanager.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:11:04.743 INFO:journalctl@ceph.alertmanager.a.smithi047.stdout:Apr 06 04:11:04 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@alertmanager.a.service: Consumed 2.293s CPU time. 2024-04-06T04:11:05.122 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:04 smithi047 podman[154008]: 2024-04-06 04:11:04.841659551 +0000 UTC m=+0.118242853 container died 17bf4fcef0258c487685ccbc7dada888893196169e206db550d3c92f35267fb4 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-04-06T04:11:05.122 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:05 smithi047 podman[154008]: 2024-04-06 04:11:05.122493322 +0000 UTC m=+0.399076616 container cleanup 17bf4fcef0258c487685ccbc7dada888893196169e206db550d3c92f35267fb4 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-04-06T04:11:05.473 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:05 smithi047 bash[154008]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a 2024-04-06T04:11:05.735 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:05 smithi047 podman[154022]: 2024-04-06 04:11:05.473592988 +0000 UTC m=+0.636410971 container remove 17bf4fcef0258c487685ccbc7dada888893196169e206db550d3c92f35267fb4 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-04-06T04:11:05.735 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:05 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-04-06T04:11:05.735 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:05 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@node-exporter.a.service: Failed with result 'exit-code'. 2024-04-06T04:11:05.736 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:05 smithi047 systemd[1]: Stopped Ceph node-exporter.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:11:05.736 INFO:journalctl@ceph.node-exporter.a.smithi047.stdout:Apr 06 04:11:05 smithi047 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@node-exporter.a.service: Consumed 5.068s CPU time. 2024-04-06T04:11:06.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm rm-cluster --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 --force --keep-logs 2024-04-06T04:11:06.397 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T04:11:07.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:07 smithi102 systemd[1]: Stopping Ceph iscsi.iscsi.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:11:08.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:07 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a[59880]: debug Shutdown received 2024-04-06T04:11:18.159 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:17 smithi102 bash[76528]: time="2024-04-06T04:11:17Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a in 10 seconds, resorting to SIGKILL" 2024-04-06T04:11:18.160 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:17 smithi102 podman[76528]: 2024-04-06 04:11:17.892641839 +0000 UTC m=+10.123089924 container died afd087c7113678925f06f718cd75b70aeec3ca316d92d5468ff3a35320520e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a, maintainer=Guillaume Abrioux , RELEASE=squid-9f19235, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-06T04:11:18.509 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:18 smithi102 podman[76528]: 2024-04-06 04:11:18.241660329 +0000 UTC m=+10.472108420 container cleanup afd087c7113678925f06f718cd75b70aeec3ca316d92d5468ff3a35320520e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-9f19235) 2024-04-06T04:11:18.509 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:18 smithi102 bash[76528]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a 2024-04-06T04:11:18.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:18 smithi102 podman[76543]: 2024-04-06 04:11:18.509437746 +0000 UTC m=+0.617364649 container remove afd087c7113678925f06f718cd75b70aeec3ca316d92d5468ff3a35320520e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a592ef0f2cc60f3f7bee762d48a80bb237e35213427028fdb29a2b5d27584e3c, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-iscsi-iscsi-a, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-9f19235, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-06T04:11:18.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:18 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-04-06T04:11:18.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:18 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-04-06T04:11:18.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:18 smithi102 systemd[1]: Stopped Ceph iscsi.iscsi.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:11:18.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi102.stdout:Apr 06 04:11:18 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@iscsi.iscsi.a.service: Consumed 4.329s CPU time. 2024-04-06T04:11:20.397 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:20 smithi102 systemd[1]: Stopping Ceph grafana.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:11:20.693 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=server t=2024-04-06T04:11:20.433979493Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-04-06T04:11:20.693 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=tracing t=2024-04-06T04:11:20.434329957Z level=info msg="Closing tracing" 2024-04-06T04:11:20.693 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:20 smithi102 ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a[63464]: logger=ticker t=2024-04-06T04:11:20.434373449Z level=info msg=stopped last_tick=2024-04-06T04:11:20Z 2024-04-06T04:11:20.693 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:20 smithi102 podman[76805]: 2024-04-06 04:11:20.444394373 +0000 UTC m=+0.126174230 container died e649251a58f8eb23364a02da2cd25fc7d8c13ff96fc8b4186b7cf34172180d5b (image=quay.io/ceph/grafana:9.4.12, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-04-06T04:11:21.083 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:20 smithi102 podman[76805]: 2024-04-06 04:11:20.766884832 +0000 UTC m=+0.448664670 container cleanup e649251a58f8eb23364a02da2cd25fc7d8c13ff96fc8b4186b7cf34172180d5b (image=quay.io/ceph/grafana:9.4.12, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-04-06T04:11:21.083 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:20 smithi102 bash[76805]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a 2024-04-06T04:11:21.083 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:20 smithi102 podman[76819]: 2024-04-06 04:11:20.917978745 +0000 UTC m=+0.474836207 container remove e649251a58f8eb23364a02da2cd25fc7d8c13ff96fc8b4186b7cf34172180d5b (image=quay.io/ceph/grafana:9.4.12, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-04-06T04:11:21.583 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:21 smithi102 systemd[1]: Stopping Ceph node-exporter.b for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4... 2024-04-06T04:11:21.583 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:21 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@grafana.a.service: Deactivated successfully. 2024-04-06T04:11:21.583 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:21 smithi102 systemd[1]: Stopped Ceph grafana.a for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:11:21.584 INFO:journalctl@ceph.grafana.a.smithi102.stdout:Apr 06 04:11:21 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@grafana.a.service: Consumed 22.185s CPU time. 2024-04-06T04:11:21.896 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:21 smithi102 podman[76941]: 2024-04-06 04:11:21.614440729 +0000 UTC m=+0.127594871 container died b52dea25f4f545635b769a3fe7c6ad328e5c024dcae0d4046b959a68809c6e4c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-04-06T04:11:22.238 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:21 smithi102 podman[76941]: 2024-04-06 04:11:21.996077389 +0000 UTC m=+0.509231531 container cleanup b52dea25f4f545635b769a3fe7c6ad328e5c024dcae0d4046b959a68809c6e4c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-04-06T04:11:22.238 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:21 smithi102 bash[76941]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b 2024-04-06T04:11:22.583 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:22 smithi102 podman[76956]: 2024-04-06 04:11:22.238524648 +0000 UTC m=+0.628527680 container remove b52dea25f4f545635b769a3fe7c6ad328e5c024dcae0d4046b959a68809c6e4c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-04-06T04:11:22.583 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:22 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-04-06T04:11:22.583 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:22 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@node-exporter.b.service: Failed with result 'exit-code'. 2024-04-06T04:11:22.583 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:22 smithi102 systemd[1]: Stopped Ceph node-exporter.b for 8f6329a8-f3c5-11ee-b649-cb9ed24678a4. 2024-04-06T04:11:22.583 INFO:journalctl@ceph.node-exporter.b.smithi102.stdout:Apr 06 04:11:22 smithi102 systemd[1]: ceph-8f6329a8-f3c5-11ee-b649-cb9ed24678a4@node-exporter.b.service: Consumed 4.888s CPU time. 2024-04-06T04:11:23.015 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-06T04:11:23.051 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-06T04:11:23.079 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-06T04:11:23.093 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934/remote/smithi047/crash 2024-04-06T04:11:23.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/crash -- . 2024-04-06T04:11:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-06T04:11:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2024-04-06T04:11:23.158 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934/remote/smithi102/crash 2024-04-06T04:11:23.162 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/crash -- . 2024-04-06T04:11:23.209 INFO:teuthology.orchestra.run.smithi102.stderr:tar: /var/lib/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-06T04:11:23.209 INFO:teuthology.orchestra.run.smithi102.stderr:tar: Error is not recoverable: exiting now 2024-04-06T04:11:23.210 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-06T04:11:23.210 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-06T04:11:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:2024-04-06T03:40:00.000178+0000 mon.a (mon.0) 2093 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-04-06T04:11:23.247 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-06T04:11:23.247 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[SEC\]' /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-06T04:11:23.325 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]' /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-06T04:11:23.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[WRN\]' /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-06T04:11:23.469 INFO:teuthology.orchestra.run.smithi047.stdout:2024-04-06T03:40:00.000178+0000 mon.a (mon.0) 2093 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-04-06T04:11:23.470 INFO:tasks.cephadm:Compressing logs... 2024-04-06T04:11:23.470 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-06T04:11:23.512 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-06T04:11:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.a.log 2024-04-06T04:11:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:: No such file or directory 2024-04-06T04:11:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.audit.log 2024-04-06T04:11:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-client.rgw.foo.a.log 2024-04-06T04:11:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.1.log 2024-04-06T04:11:23.537 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.3.log 2024-04-06T04:11:23.537 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.audit.log: /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-client.rgw.foo.a.log: /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mgr.y.log 2024-04-06T04:11:23.538 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-06T04:11:23.538 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.6.log 2024-04-06T04:11:23.538 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.audit.log 2024-04-06T04:11:23.538 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.4.log 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.6.log: /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.7.log 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.5.log 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mgr.x.log 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.7.log: /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/tcmu-runner.log 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.cephadm.log 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/tcmu-runner.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr: 66.9% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/tcmu-runner.log.gz 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.cephadm.log: 81.5% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.cephadm.log.gz 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-volume.log 2024-04-06T04:11:23.543 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.b.log 2024-04-06T04:11:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.0.log 2024-04-06T04:11:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mgr.y.log: /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.cephadm.log 2024-04-06T04:11:23.548 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-volume.log: 88.0% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log.gz 2024-04-06T04:11:23.548 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-06T04:11:23.550 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.b.log: 92.3% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.audit.log.gz 2024-04-06T04:11:23.553 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/cephadm.log: 92.5% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mgr.x.log.gz 2024-04-06T04:11:23.558 INFO:teuthology.orchestra.run.smithi047.stderr: 95.3% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.audit.log.gz 2024-04-06T04:11:23.558 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log 2024-04-06T04:11:23.558 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.cephadm.log: 89.0% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.cephadm.log.gz 2024-04-06T04:11:23.559 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-volume.log.gz 2024-04-06T04:11:23.559 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.2.log 2024-04-06T04:11:23.564 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-06T04:11:23.567 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-volume.log 2024-04-06T04:11:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.2.log: 93.3% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph.log.gz 2024-04-06T04:11:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.c.log 2024-04-06T04:11:23.584 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-06T04:11:23.594 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.c.log: /var/log/ceph/cephadm.log: 91.0% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-volume.log.gz 2024-04-06T04:11:23.606 INFO:teuthology.orchestra.run.smithi047.stderr: 94.0% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-client.rgw.foo.a.log.gz 2024-04-06T04:11:23.613 INFO:teuthology.orchestra.run.smithi047.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-06T04:11:24.109 INFO:teuthology.orchestra.run.smithi047.stderr: 90.7% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mgr.y.log.gz 2024-04-06T04:11:24.836 INFO:teuthology.orchestra.run.smithi047.stderr: 92.7% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.c.log.gz 2024-04-06T04:11:25.094 INFO:teuthology.orchestra.run.smithi102.stderr: 92.9% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.b.log.gz 2024-04-06T04:11:26.000 INFO:teuthology.orchestra.run.smithi047.stderr: 91.8% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-mon.a.log.gz 2024-04-06T04:11:30.638 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.6.log.gz 2024-04-06T04:11:31.256 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.5.log.gz 2024-04-06T04:11:31.269 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.2.log.gz 2024-04-06T04:11:31.382 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.7.log.gz 2024-04-06T04:11:31.973 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.0.log.gz 2024-04-06T04:11:32.167 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.4.log.gz 2024-04-06T04:11:32.169 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-06T04:11:32.169 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m8.643s 2024-04-06T04:11:32.169 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m31.760s 2024-04-06T04:11:32.169 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m1.099s 2024-04-06T04:11:32.266 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.3.log.gz 2024-04-06T04:11:32.511 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/8f6329a8-f3c5-11ee-b649-cb9ed24678a4/ceph-osd.1.log.gz 2024-04-06T04:11:32.513 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-06T04:11:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m8.990s 2024-04-06T04:11:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m36.930s 2024-04-06T04:11:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m1.204s 2024-04-06T04:11:32.513 INFO:tasks.cephadm:Archiving logs... 2024-04-06T04:11:32.513 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934/remote/smithi047/log 2024-04-06T04:11:32.514 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-06T04:11:37.426 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934/remote/smithi102/log 2024-04-06T04:11:37.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-06T04:11:42.168 INFO:tasks.cephadm:Removing cluster... 2024-04-06T04:11:42.169 DEBUG:teuthology.orchestra.run.smithi047:> sudo cephadm rm-cluster --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 --force 2024-04-06T04:11:42.367 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T04:11:42.660 DEBUG:teuthology.orchestra.run.smithi102:> sudo cephadm rm-cluster --fsid 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 --force 2024-04-06T04:11:42.860 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: 8f6329a8-f3c5-11ee-b649-cb9ed24678a4 2024-04-06T04:11:43.151 INFO:tasks.cephadm:Teardown complete 2024-04-06T04:11:43.152 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-06T04:11:43.164 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-06T04:11:43.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-06T04:11:43.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-06T04:11:43.248 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-06T04:11:43.256 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-06T04:11:43.256 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-06T04:11:43.259 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-06T04:11:43.272 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-04-06T04:11:43.273 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-04-06T04:11:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-06T04:11:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-04-06T04:11:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 39 -152us[ -147us] +/- 97ms 2024-04-06T04:11:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -235us[ -229us] +/- 62ms 2024-04-06T04:11:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 105 +409us[ +422us] +/- 62ms 2024-04-06T04:11:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T04:11:43.278 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-06T04:11:43.278 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-04-06T04:11:43.278 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 38 -174us[ -174us] +/- 97ms 2024-04-06T04:11:43.278 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv02.front.sepia.ceph.com 3 7 377 42 -218us[ -215us] +/- 62ms 2024-04-06T04:11:43.278 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 44 +413us[ +416us] +/- 63ms 2024-04-06T04:11:43.278 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T04:11:43.279 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-06T04:11:43.288 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-06T04:11:43.289 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-06T04:11:43.314 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-06T04:11:43.403 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-06T04:11:43.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-06T04:11:43.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T04:11:43.511 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-06T04:11:43.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T04:11:43.541 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-06T04:11:43.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-06T04:11:43.573 INFO:teuthology.task.internal:Duration was 3088.199897 seconds 2024-04-06T04:11:43.573 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-06T04:11:43.606 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-06T04:11:43.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-06T04:11:43.610 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-06T04:11:43.652 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-06T04:11:43.653 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-06T04:11:44.043 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-06T04:11:44.043 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-04-06T04:11:44.043 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-06T04:11:44.066 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-04-06T04:11:44.067 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-06T04:11:44.102 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-06T04:11:44.102 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-06T04:11:44.114 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-06T04:11:44.174 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-06T04:11:44.174 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-06T04:11:44.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-06T04:11:44.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-06T04:11:44.672 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-06T04:11:44.673 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-06T04:11:44.700 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-06T04:11:44.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-06T04:11:44.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-06T04:11:44.743 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-06T04:11:44.766 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-04-06T04:11:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-04-06T04:11:44.820 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-06T04:11:44.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T04:11:44.836 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-06T04:11:44.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T04:11:44.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-06T04:11:44.884 INFO:teuthology.task.internal:Transferring archived files... 2024-04-06T04:11:44.885 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934/remote/smithi047 2024-04-06T04:11:44.885 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-06T04:11:44.954 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934/remote/smithi102 2024-04-06T04:11:44.954 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-06T04:11:44.994 INFO:teuthology.task.internal:Removing archive directory... 2024-04-06T04:11:44.995 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-06T04:11:44.997 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-06T04:11:45.043 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-06T04:11:45.056 INFO:teuthology.task.internal:Not uploading archives. 2024-04-06T04:11:45.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-06T04:11:45.104 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-06T04:11:45.105 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-06T04:11:45.107 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-06T04:11:45.119 INFO:teuthology.orchestra.run.smithi047.stdout: 265306 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 6 04:11 /home/ubuntu/cephtest 2024-04-06T04:11:45.122 INFO:teuthology.orchestra.run.smithi102.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 6 04:11 /home/ubuntu/cephtest 2024-04-06T04:11:45.123 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-06T04:11:45.141 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-06T04:11:45.207 INFO:teuthology.nuke:Checking targets against current locks 2024-04-06T04:11:45.235 DEBUG:teuthology.nuke:shortname: smithi047 2024-04-06T04:11:45.235 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-06T04:11:45.257 DEBUG:teuthology.nuke:shortname: smithi102 2024-04-06T04:11:45.257 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-06T04:11:45.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-06 03:11:08.128629', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI1cEsLkHa93Q+cIob9h3X2IcOdJd3tHOJ2sqLEN5BmJtlVrLacnB2ce9eNcLxj/TnQ7KMOCIEDMizOfOSEoo6M='} 2024-04-06T04:11:45.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-05_21:08:03-orch-squid-distro-default-smithi/7641934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-06 03:11:08.127264', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJRiuYufg69nO624sWYbxrly7zLSidXuHlOjBhm0Pt9H6rlgMK+aq7YahZOT7MICJaG0e/fOuSbagWBw7Lv5h8c='} 2024-04-06T04:11:45.309 INFO:teuthology.orchestra.console.smithi047:Power off 2024-04-06T04:11:45.309 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-06T04:11:45.328 INFO:teuthology.orchestra.console.smithi102:Power off 2024-04-06T04:11:45.328 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-06T04:11:45.338 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-04-06T04:11:45.338 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T04:11:45.352 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-04-06T04:11:45.353 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T04:11:45.364 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-06T04:11:45.375 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-06T04:11:49.365 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T04:11:49.376 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T04:11:49.475 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-06T04:11:49.485 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-06T04:11:53.478 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T04:11:53.486 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T04:11:53.589 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-04-06T04:11:53.594 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-06T04:11:53.690 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-04-06T04:11:57.598 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T04:11:57.707 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-04-06T04:11:57.808 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-04-06T04:11:57.912 INFO:teuthology.run:Summary data: description: orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} duration: 3088.1998965740204 failure_reason: '"2024-04-06T03:40:00.000178+0000 mon.a (mon.0) 2093 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-04-06T04:11:57.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T04:11:57.999 INFO:teuthology.run:FAIL